-- Logs begin at Thu 2022-07-28 16:48:23 UTC, end at Thu 2022-07-28 18:07:06 UTC. -- Jul 28 17:35:31.283795 dv-cinder-813229-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 17:35:31.292585 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:35:31 2022] *** Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: nodename: dv-cinder-813229-13-iscsi Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: machine: x86_64 Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: clock source: unix Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: pcre jit disabled Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: detected number of CPU cores: 4 Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: current working directory: / Jul 28 17:35:31.294593 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: your processes number limit is 47680 Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: your memory page size is 4096 bytes Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: detected max file descriptor number: 2048 Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: lock engine: pthread robust mutexes Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: thunder lock: enabled Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 17:35:31.295289 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:35:31.335497 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: Python main interpreter initialized at 0x560e7fe5c9c0 Jul 28 17:35:31.335497 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: python threads support enabled Jul 28 17:35:31.335497 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: your server socket listen backlog is limited to 100 connections Jul 28 17:35:31.335497 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:35:31.335857 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:35:31.335934 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: *** Operational MODE: preforking *** Jul 28 17:35:31.336162 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:35:31.336162 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: spawned uWSGI master process (pid: 109983) Jul 28 17:35:31.336361 dv-cinder-813229-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 17:35:31.337245 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: spawned uWSGI worker 1 (pid: 109984, cores: 1) Jul 28 17:35:31.337245 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: spawned uWSGI worker 2 (pid: 109985, cores: 1) Jul 28 17:35:31.337416 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:35:32.007348 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:35:32.018240 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:35:33.111743 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:35:33.111743 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: from cryptography.utils import int_from_bytes Jul 28 17:35:33.112318 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:35:33.112318 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: from cryptography.utils import int_from_bytes Jul 28 17:35:33.113096 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:35:33.113096 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: from cryptography.utils import int_from_bytes Jul 28 17:35:33.113633 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:35:33.113633 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: from cryptography.utils import int_from_bytes Jul 28 17:35:35.698121 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:35:35.698787 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:35:35.698906 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:35:35.699228 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:35:35.699478 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:35:35.699856 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.700178 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.700492 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.700814 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.701016 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:35:35.701441 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.701541 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:35:35.701634 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.701771 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.701859 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:35:35.702083 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.702178 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:35:35.702408 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.702497 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:35:35.702667 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.702793 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.702978 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703123 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703298 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-13-iscsi {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703447 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703617 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.703918 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.704216 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.704495 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.704612 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.704850 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705127 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705335 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705474 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705602 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705736 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.705862 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706013 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706150 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706378 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-13-iscsi {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706518 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706710 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.706939 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707080 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707244 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707359 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707553 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707674 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.707886 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708026 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708197 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708326 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708503 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708629 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.708819 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709007 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709190 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709329 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709456 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709649 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709807 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.709962 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710119 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-13-iscsi {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710297 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710435 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710613 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710735 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.710924 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711036 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711248 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711435 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711582 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711747 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.711892 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712055 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712208 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712374 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712525 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-13-iscsi {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712678 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712826 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.712974 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.713123 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.713323 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.713478 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.713628 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.713868 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714014 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714181 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714326 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714476 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714622 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714797 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.714949 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715107 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715252 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715399 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715544 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715683 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715819 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.715986 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716145 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716285 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716432 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716572 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716710 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.716847 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717088 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717272 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717413 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717561 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717716 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.717862 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718011 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718438 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718576 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718721 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.718880 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.719018 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.719155 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.719304 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.719442 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.719591 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.720274 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.720492 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.720639 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.720788 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.720967 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721230 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721382 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721531 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721672 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721810 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.721964 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722111 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722250 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722389 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722525 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722671 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722817 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.722961 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723111 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723249 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723387 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723537 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723682 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723826 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.723969 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724106 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724291 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724446 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724608 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724752 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.724930 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725084 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725270 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725565 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725700 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.725868 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726019 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726157 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726303 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726449 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726596 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726744 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.726898 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727063 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727272 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727423 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727562 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727699 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727836 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.727985 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728125 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728269 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728413 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728559 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728698 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728855 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.728994 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729223 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729369 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729518 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729665 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729817 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.729963 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730101 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730238 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730375 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730525 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730664 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730820 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.730958 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731095 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731251 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731538 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731691 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731832 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.731970 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732106 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732242 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732387 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732525 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732662 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732811 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.732948 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733085 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733269 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733566 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733711 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.733865 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734014 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734161 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734307 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734454 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734603 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734747 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.734892 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.735044 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.735189 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.735328 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.736074 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.736222 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.736406 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.736725 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.736890 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737033 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737207 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737457 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737618 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737767 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.737906 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738045 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738182 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738318 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738463 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738603 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738748 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.738894 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739032 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739178 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739336 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739475 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739612 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739749 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.739884 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740021 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740178 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740317 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740461 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740600 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740743 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.740892 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741045 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741253 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741408 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741631 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741776 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.741922 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742060 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742197 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742335 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742472 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742609 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742755 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.742900 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743039 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743186 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743325 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743463 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743612 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743757 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.743895 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.744039 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.744187 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.744327 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.744473 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.744611 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.744748 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.744902 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.745041 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.745220 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.745395 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.745539 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.745710 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.745898 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.746057 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.746205 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:35:35.746344 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.746482 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.746619 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.746763 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.746912 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747064 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747202 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747347 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747572 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747717 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.747866 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748005 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748150 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748288 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748570 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748730 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.748869 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749014 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749192 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749339 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749500 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749650 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749796 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.749941 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750080 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750216 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750397 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750552 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750703 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.750841 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.751064 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.751386 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.751684 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.751856 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752005 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752144 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752294 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752433 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752570 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752785 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.752941 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.753092 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.753274 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.753676 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.753816 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.753967 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754107 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754245 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754393 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754531 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754682 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754830 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.754969 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755127 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755268 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755405 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755557 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755696 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.755833 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756013 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756169 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756316 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756463 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756636 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756782 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.756971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757141 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757331 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757706 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757852 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.757992 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758130 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758282 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758422 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758559 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758834 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.758978 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759150 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759297 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759436 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759579 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759717 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.759854 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760000 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760139 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760276 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760414 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760558 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760703 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.760851 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761010 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761351 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761488 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761625 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.761796 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762013 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762158 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762304 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762442 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762592 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762737 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.762886 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763033 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763174 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763312 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763462 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763600 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763744 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.763883 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764020 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764164 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764318 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764469 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764615 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764763 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.764910 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765049 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765226 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765373 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765512 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765649 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765795 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.765942 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.766081 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.766219 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.766396 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.766548 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.767322 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.767657 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.767888 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768038 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768182 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768333 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768634 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768779 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.768935 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769081 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769294 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769453 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769624 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769770 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.769921 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770066 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770210 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770364 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770516 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770662 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770806 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.770956 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771101 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771254 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771409 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771554 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771698 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.771841 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772010 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772234 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772385 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772529 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772819 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.772964 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773120 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773314 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773472 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773617 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773762 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.773916 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774063 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774207 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774351 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774502 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774658 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774814 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.774960 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775104 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775256 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775411 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775556 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775713 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.775860 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776011 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776165 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776317 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776470 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776626 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776772 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.776924 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777069 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777248 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777423 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777570 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777722 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.777884 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778099 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778249 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778406 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778559 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778704 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778848 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.778993 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779136 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779298 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779444 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779588 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779738 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.779882 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780027 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780183 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780328 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780471 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780615 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780758 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.780910 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781057 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781243 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781394 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781538 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781681 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.781911 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.782058 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.782230 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783075 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783175 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783175 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783392 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783487 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783746 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.783846 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784071 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784161 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784389 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784480 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784714 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.784814 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785018 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785105 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785361 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785456 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785674 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785763 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.785987 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786083 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786298 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786388 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786612 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786721 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.786928 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787031 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787239 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787328 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787547 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787635 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787851 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.787947 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788163 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788250 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788470 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788557 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788787 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.788891 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789088 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789194 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789429 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789521 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789739 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.789834 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790068 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790155 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790374 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790460 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790684 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790774 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.790992 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791077 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791301 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791388 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791612 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791708 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.791924 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792027 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792230 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792361 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792557 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792844 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.792931 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793183 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793274 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793492 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793581 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793800 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.793888 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794106 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794192 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794418 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794507 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794730 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.794903 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795055 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795202 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795360 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795516 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795676 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795832 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.795979 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796135 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796289 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796435 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796579 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796722 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.796868 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797021 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797185 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797357 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797511 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797656 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797809 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.797969 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.798264 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.798519 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.798685 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.798840 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.798988 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799163 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799318 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799464 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799609 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799753 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.799896 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800051 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800207 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800352 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800495 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800638 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800791 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.800945 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801092 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801276 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801425 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801568 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801732 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.801887 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802037 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802200 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802346 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802490 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802642 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802788 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.802933 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803085 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803316 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803468 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803624 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803770 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.803914 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804066 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804223 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804367 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804520 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804673 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804827 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.804972 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805116 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805341 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805491 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805636 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805787 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.805933 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806077 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806241 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806387 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806532 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806683 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806829 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.806973 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807129 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807277 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807422 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807574 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807719 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.807871 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808036 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808183 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808356 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808575 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808734 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.808888 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809035 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809206 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809359 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809517 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809745 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.809901 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810062 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810227 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810391 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810538 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810682 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810833 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.810987 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811134 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811278 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811421 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811583 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811739 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.811894 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812049 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812207 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812359 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812506 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812659 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812812 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.812966 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813121 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813272 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813365 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813438 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813540 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.813736 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814229 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814348 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814422 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814489 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814656 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814789 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.814970 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815152 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815304 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815451 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815614 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815769 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.815917 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816074 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816226 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816372 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816525 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816673 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816820 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.816977 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817123 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817331 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817496 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817644 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817791 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.817943 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818100 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818254 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818400 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818573 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818798 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.818951 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819096 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819251 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819397 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819542 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819688 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819835 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.819979 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820143 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820289 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820434 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820579 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820723 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.820867 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821021 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821191 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821343 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821488 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821632 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821792 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.821958 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822103 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822256 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822402 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822547 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822710 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.822874 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823031 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823176 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823329 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823560 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823722 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.823878 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824042 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824473 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824626 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824772 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.824925 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825071 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825236 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825398 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825545 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825691 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825835 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.825991 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826138 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826291 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826444 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826596 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826742 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.826887 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.827032 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.827186 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.827332 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.827476 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.827621 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.828341 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.828501 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.828662 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.828827 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.829057 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.829746 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.829953 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830149 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830314 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830538 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830538 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830986 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.830986 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.831307 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.831463 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.831610 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.831755 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.831908 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832063 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832063 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832340 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832340 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832614 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832759 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.832929 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833077 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833077 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833443 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833680 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833833 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.833988 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834136 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834282 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834572 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834726 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.834872 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835018 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835176 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835331 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835478 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835640 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835787 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.835934 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836085 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836232 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836376 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836600 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836749 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.836895 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837039 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837039 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837369 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837526 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837526 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837805 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.837976 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838077 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838177 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838177 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838329 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838409 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838488 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838565 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838652 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838791 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.838925 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839095 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839244 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839410 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839600 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839726 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.839914 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840076 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840278 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840437 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840602 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840759 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.840914 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841069 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841277 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841442 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841596 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841750 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.841898 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842043 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842195 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842350 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842496 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842641 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842797 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.842958 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843104 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843258 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843404 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843549 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843713 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.843933 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.844092 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.844249 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.844395 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.844540 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.844684 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.845427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.845657 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.845902 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846072 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846305 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846472 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846654 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846816 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.846964 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847111 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847257 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847403 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847560 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847721 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.847882 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848038 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848340 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848486 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848641 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848788 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.848934 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849078 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849266 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849414 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849585 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.849877 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850022 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850166 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850326 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850473 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850618 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850771 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.850918 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851062 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851225 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851373 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851527 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851680 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851826 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.851977 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852137 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852290 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852438 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852589 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852736 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.852881 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853210 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853383 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853530 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853684 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.853849 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854084 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854237 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854383 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854536 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854689 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854844 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.854998 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855145 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855289 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855444 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855590 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855743 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.855890 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856034 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856179 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856323 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856476 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856642 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856795 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.856941 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857086 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857264 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857436 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857597 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857744 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.857889 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858039 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858185 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858338 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858484 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858630 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858775 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.858919 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859070 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859236 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859382 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859533 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859680 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859824 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.859978 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.860124 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.860268 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.860443 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.860588 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.860929 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861089 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861280 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861437 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861582 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861737 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.861971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862134 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862282 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862523 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862682 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862829 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.862974 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863119 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863263 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863416 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863575 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863721 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.863866 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864011 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864246 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864406 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864560 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864707 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.864860 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865007 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865151 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865336 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865484 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865639 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865783 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.865927 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866082 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866228 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866382 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866527 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866679 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866824 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.866983 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867129 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867274 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867430 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867575 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867719 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.867872 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868018 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868173 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868319 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868464 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868684 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868846 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.868993 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869146 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869331 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869490 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869644 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869790 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.869935 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870081 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870226 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870370 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870527 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870680 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870826 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.870971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871115 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871262 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871426 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871573 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871718 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.871864 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872009 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872163 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872317 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872470 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872629 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872784 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.872929 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873088 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873312 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873480 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873635 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873792 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.873938 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874099 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874265 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874484 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874635 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874783 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.874934 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875090 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875236 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875393 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875551 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875706 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.875929 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876192 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876403 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876556 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876556 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876833 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.876989 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877136 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877309 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877457 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877615 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877762 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.877922 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.878069 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.878214 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.878616 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.878767 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.878913 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879066 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879214 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879359 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879509 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879656 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879828 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.879974 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880119 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880271 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880418 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880570 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880727 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.880880 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881026 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881210 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881364 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881510 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881678 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881826 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.881971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882116 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882261 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882406 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882567 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882713 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.882859 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883004 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883149 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883303 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883459 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883616 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883769 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.883925 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884070 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884238 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884385 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884616 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884770 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.884923 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885078 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885274 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885726 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.885726 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886002 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886157 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886303 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886483 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886674 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886823 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886979 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.886979 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.887266 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.887411 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.887564 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.887721 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.887875 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888024 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888170 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888314 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888460 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888605 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888771 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.888919 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889065 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889233 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889384 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889541 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889703 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.889851 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890004 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890150 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890296 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890447 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890594 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890738 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.890890 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.891037 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.891182 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.891336 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.891493 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.892279 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.892748 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.892900 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893072 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893305 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893457 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893610 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893765 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.893912 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894070 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894217 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894377 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894533 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894766 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.894918 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895075 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895222 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895376 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895522 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895674 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895827 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.895983 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896129 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896286 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896433 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896578 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896732 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.896879 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897024 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897222 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897375 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897533 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897676 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897788 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.897888 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898030 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898161 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898390 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898539 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898710 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.898846 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899022 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899115 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899339 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899476 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899655 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899788 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.899971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900120 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900287 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900602 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900744 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.900913 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901060 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901247 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901337 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901556 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901761 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.901858 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902083 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902219 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902469 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902557 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902795 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.902890 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903119 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903210 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903435 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903525 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903749 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.903846 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904066 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904154 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904367 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904457 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904672 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.904901 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905003 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905249 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905344 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905590 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905690 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.905910 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906003 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906237 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906333 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906518 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906616 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906834 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.906929 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.907140 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.907297 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.908079 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.908342 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.908659 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.908790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.908974 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909114 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909308 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909455 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909636 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909767 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.909952 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910083 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910262 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910401 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910586 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910715 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.910899 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911028 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911253 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911445 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911576 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911795 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.911924 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912115 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912253 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912444 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912573 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912744 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.912873 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913053 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913228 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913389 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913519 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913695 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.913825 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914002 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914140 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914305 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914434 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914622 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914759 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.914927 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915057 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915233 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915337 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915538 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915636 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915845 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.915944 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916148 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916247 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916453 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916560 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916757 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.916856 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917061 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917178 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917396 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917497 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917698 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.917802 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918005 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918103 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918307 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918406 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918616 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.918919 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919009 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919224 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919328 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919569 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919667 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.919891 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920053 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920330 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920504 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920639 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920803 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.920933 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921112 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921280 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921460 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921593 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921770 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.921903 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922079 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922223 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922423 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922553 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922735 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.922883 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.923238 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.923566 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.923793 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.923925 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924133 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924263 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924458 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924595 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924793 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.924932 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925107 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925255 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925449 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925578 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925757 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.925887 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926064 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926310 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926453 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926647 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926777 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.926971 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927102 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927278 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927407 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927589 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.927898 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928035 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928282 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928422 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928548 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928672 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928797 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.928932 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929101 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929276 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929436 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929568 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929744 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.929882 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930053 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930360 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930490 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930673 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930811 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.930981 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931111 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931299 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931428 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931613 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.931924 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932055 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932233 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932361 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932542 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932677 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932848 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.932976 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.933171 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.933314 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.933549 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.933683 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.933942 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934078 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934272 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934401 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934597 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934727 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.934921 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935050 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935243 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935374 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935559 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935809 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.935938 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.936176 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.936311 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.936516 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.936722 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.936859 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.937114 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.937303 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.937456 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.937767 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.937896 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.938180 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.938309 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.938599 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.938931 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.939261 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.939401 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.939574 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.939901 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.940027 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.940229 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.940502 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.940631 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.940858 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941031 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941181 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941412 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941543 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941769 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.941897 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942114 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942250 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942454 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942573 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942773 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.942888 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943085 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943224 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943392 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943529 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943705 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.943833 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944026 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944162 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944337 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944464 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944644 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944773 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.944951 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945093 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945289 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945419 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945595 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945724 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.945902 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946044 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946207 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946349 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946512 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946641 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946820 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.946958 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947122 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947251 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947552 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947728 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.947865 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948027 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948205 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948342 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948467 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948687 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948826 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.948954 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949069 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949214 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949341 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949512 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949642 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949814 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.949944 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950115 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950246 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950416 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950546 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950748 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.950884 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951077 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951213 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951391 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951521 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951712 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.951840 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952021 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952158 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952343 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952471 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952646 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952773 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.952969 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953098 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953313 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953441 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953630 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953759 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.953939 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.954591 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.954803 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955121 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955324 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955452 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955656 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955787 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.955978 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956107 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956299 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956427 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956615 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956754 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.956929 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957060 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957271 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957413 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957593 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957721 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.957916 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958044 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958226 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958366 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958550 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958692 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.958884 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959013 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959172 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959312 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959486 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959617 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959799 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.959927 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960116 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960253 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960551 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960734 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.960860 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961038 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961196 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961382 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961510 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961698 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.961829 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962018 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962147 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962337 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962475 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962642 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962780 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.962956 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963086 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963269 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963406 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963590 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963726 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.963909 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964044 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964217 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964345 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964540 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964679 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.964864 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.965033 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.965228 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.965542 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.965703 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.965882 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966210 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966337 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966525 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966663 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966835 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.966965 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.967138 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.967266 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:35:35.967398 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:35:35.967525 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:35:36.121904 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO dbcounter [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Registered counter for database nova_api Jul 28 17:35:36.125434 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO dbcounter [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Registered counter for database nova_api Jul 28 17:35:36.142898 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_db.sqlalchemy.engines [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.146176 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.149728 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writer thread running {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.152594 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writer thread running {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.211199 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.context [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c442d92-b981-4069-943a-49d075b5aed3(cell1) {{(pid=109985) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:35:36.214422 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.context [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c442d92-b981-4069-943a-49d075b5aed3(cell1) {{(pid=109984) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:35:36.215322 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_concurrency.lockutils [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:35:36.216940 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_concurrency.lockutils [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:35:36.217770 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_concurrency.lockutils [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:35:36.218374 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:35:36.220300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_concurrency.lockutils [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:35:36.221119 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:35:36.221932 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:35:36.222453 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO dbcounter [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Registered counter for database nova_cell0 Jul 28 17:35:36.223894 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:35:36.225887 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO dbcounter [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Registered counter for database nova_cell0 Jul 28 17:35:36.227894 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO dbcounter [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Registered counter for database nova_cell1 Jul 28 17:35:36.231433 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO dbcounter [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Registered counter for database nova_cell1 Jul 28 17:35:36.235356 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_db.sqlalchemy.engines [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.238143 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_db.sqlalchemy.engines [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.239808 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.243596 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.245376 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writer thread running {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.245492 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writer thread running {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.245721 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writer thread running {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.404652 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writer thread running {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.408216 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO dbcounter [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Registered counter for database nova_cell0 Jul 28 17:35:36.414159 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO dbcounter [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Registered counter for database nova_cell0 Jul 28 17:35:36.416390 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG oslo_db.sqlalchemy.engines [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.421084 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:35:36.421300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writer thread running {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.426246 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writer thread running {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:35:36.765829 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: WARNING keystonemiddleware.auth_token [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:35:36.768757 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: WARNING keystonemiddleware.auth_token [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:35:36.773244 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: WARNING keystonemiddleware.auth_token [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:35:36.775951 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: WARNING keystonemiddleware.auth_token [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:35:37.125217 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: WARNING keystonemiddleware.auth_token [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:35:37.128354 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: WARNING keystonemiddleware.auth_token [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:35:37.131643 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: WARNING keystonemiddleware.auth_token [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:35:37.134558 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: WARNING keystonemiddleware.auth_token [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:35:37.136890 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e7fe5c9c0 pid: 109985 (default app) Jul 28 17:35:37.139015 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:35:37.139753 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e7fe5c9c0 pid: 109984 (default app) Jul 28 17:35:37.140190 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-1da4829e-c8d2-4503-a83b-1b909d5817be None None] 10.222.0.89 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jul 28 17:35:37.140601 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 788 bytes} [Thu Jul 28 17:35:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:36:54.009332 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:36:54.010544 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jul 28 17:36:54.010952 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:36:54.026527 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_api:SELECT=3 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:54.027435 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_cell0:SELECT=3 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:54.028302 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_cell1:SELECT=3 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:54.029109 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:54.940540 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-97a46cca-65e4-44fc-a126-4fe372dff2b9 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:36:54.976583 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-97a46cca-65e4-44fc-a126-4fe372dff2b9 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959482 Jul 28 17:36:54.977370 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 2/3] 10.222.0.89 () {60 vars in 1291 bytes} [Thu Jul 28 17:36:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:36:57.246106 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:36:57.247108 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-fbf8ea17-99bd-4f2e-88d4-14f312d861a0 None None] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 28 17:36:57.247703 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 2/4] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:36:57.725330 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-1272b8b7-36cc-44c1-bde1-ca9d8e4d85e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:36:57.745951 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:36:57.745951 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: warnings.warn(msg) Jul 28 17:36:57.779207 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-1272b8b7-36cc-44c1-bde1-ca9d8e4d85e3 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525498 Jul 28 17:36:57.780601 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 3/5] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:36:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:36:58.006731 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-5d116cc0-19ce-4ca3-97ef-a4996c57df49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:36:58.011794 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:36:58.011794 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:36:58.015128 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_api:SELECT=3 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:58.016393 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_cell0:SELECT=3 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:58.017618 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_cell1:SELECT=3 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:58.018424 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:36:58.097287 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-5d116cc0-19ce-4ca3-97ef-a4996c57df49 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306958 Jul 28 17:36:58.097933 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 3/6] 10.222.0.89 () {64 vars in 1335 bytes} [Thu Jul 28 17:36:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:00.306313 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-1272b8b7-36cc-44c1-bde1-ca9d8e4d85e3 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:00.308006 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-1272b8b7-36cc-44c1-bde1-ca9d8e4d85e3 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Jul 28 17:37:00.308408 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 4/7] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:37:00.995841 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-a59cf1c5-84f2-4641-ac1a-b662360f8848 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "id": "d1"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:01.015697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:37:01.015697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:37:01.035038 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-a59cf1c5-84f2-4641-ac1a-b662360f8848 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.720499 Jul 28 17:37:01.042486 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 4/8] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:01.048589 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-48ad9fc9-2f85-4bc9-93c1-2c85c7244f73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:01.051967 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:37:01.051967 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: warnings.warn(msg) Jul 28 17:37:01.090231 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-48ad9fc9-2f85-4bc9-93c1-2c85c7244f73 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045484 Jul 28 17:37:01.091400 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 5/9] 10.222.0.89 () {64 vars in 1335 bytes} [Thu Jul 28 17:37:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:03.369755 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-a59cf1c5-84f2-4641-ac1a-b662360f8848 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:03.370771 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-a59cf1c5-84f2-4641-ac1a-b662360f8848 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002620 Jul 28 17:37:03.376043 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:03.780103 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-ec3f93bd-afd9-4101-bf66-9ee2e17db2df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:03.800105 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-ec3f93bd-afd9-4101-bf66-9ee2e17db2df admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422323 Jul 28 17:37:03.800783 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 6/11] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:03.812565 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-4e96cb98-5d72-4bb7-88ad-bf816db9dd5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:03.839329 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-4e96cb98-5d72-4bb7-88ad-bf816db9dd5e admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030464 Jul 28 17:37:03.840254 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 6/12] 10.222.0.89 () {64 vars in 1335 bytes} [Thu Jul 28 17:37:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:37:06.098449 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-ec3f93bd-afd9-4101-bf66-9ee2e17db2df admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:06.099488 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-ec3f93bd-afd9-4101-bf66-9ee2e17db2df admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 17:37:06.099925 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 7/13] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:06.548348 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-02ea9a4e-761a-4cd4-9128-0db3ac63b0a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:06.579902 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-02ea9a4e-761a-4cd4-9128-0db3ac63b0a7 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473949 Jul 28 17:37:06.582621 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 7/14] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:06.595891 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d0f82fd6-66b1-4f63-b397-3e60f698435c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:06.625940 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d0f82fd6-66b1-4f63-b397-3e60f698435c admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033772 Jul 28 17:37:06.626938 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 8/15] 10.222.0.89 () {64 vars in 1335 bytes} [Thu Jul 28 17:37:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:37:08.920302 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-02ea9a4e-761a-4cd4-9128-0db3ac63b0a7 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:08.921436 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-02ea9a4e-761a-4cd4-9128-0db3ac63b0a7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 28 17:37:08.927482 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 8/16] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:09.382991 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:09.407476 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478784 Jul 28 17:37:09.408336 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 9/17] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:09.421391 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-5a2bcc22-1c2d-4547-b4c1-f848722dbbd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:09.449258 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-5a2bcc22-1c2d-4547-b4c1-f848722dbbd1 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031391 Jul 28 17:37:09.449887 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 9/18] 10.222.0.89 () {64 vars in 1335 bytes} [Thu Jul 28 17:37:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:11.717288 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:11.718285 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 28 17:37:11.718686 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 10/19] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:12.159459 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-f1ef9c80-47c1-4f5a-8aa0-862d865152f1 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:12.191955 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-f1ef9c80-47c1-4f5a-8aa0-862d865152f1 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466508 Jul 28 17:37:12.192658 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 10/20] 10.222.0.89 () {60 vars in 1291 bytes} [Thu Jul 28 17:37:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:37:14.445122 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:14.446159 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-67ed2c0a-5f42-4a68-b6e2-5de387039412 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 28 17:37:14.446559 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 11/21] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:37:14.893591 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-bdfb024c-e312-4ea5-a15b-6fbec40c8aed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:14.913464 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-bdfb024c-e312-4ea5-a15b-6fbec40c8aed admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460753 Jul 28 17:37:14.914028 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 11/22] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:14.926691 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-cb338bed-4c1d-450e-9525-481ec1acc959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:14.951050 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-cb338bed-4c1d-450e-9525-481ec1acc959 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028770 Jul 28 17:37:14.951636 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 12/23] 10.222.0.89 () {64 vars in 1332 bytes} [Thu Jul 28 17:37:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:37:17.339455 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-bdfb024c-e312-4ea5-a15b-6fbec40c8aed admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:17.340456 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-bdfb024c-e312-4ea5-a15b-6fbec40c8aed admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 28 17:37:17.340858 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 12/24] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:17.746674 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-aa94c8b7-1f04-45ef-89fa-011ec88f49bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:17.766112 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-aa94c8b7-1f04-45ef-89fa-011ec88f49bb admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419450 Jul 28 17:37:17.766581 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 13/25] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:17.779043 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-cc94a7e0-10c8-4327-9055-28b9d0136b18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:17.803480 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-cc94a7e0-10c8-4327-9055-28b9d0136b18 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028003 Jul 28 17:37:17.804068 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 13/26] 10.222.0.89 () {64 vars in 1332 bytes} [Thu Jul 28 17:37:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:37:20.047171 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-aa94c8b7-1f04-45ef-89fa-011ec88f49bb admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:20.048165 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-aa94c8b7-1f04-45ef-89fa-011ec88f49bb admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 17:37:20.048564 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 14/27] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:20.444092 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-733065d7-b0b1-4dc2-98eb-8c4074ca02f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:20.465283 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-733065d7-b0b1-4dc2-98eb-8c4074ca02f3 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.409726 Jul 28 17:37:20.466123 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 14/28] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:20.478414 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-0a553139-03d7-44de-826a-e4503ce2d064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:20.502143 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-0a553139-03d7-44de-826a-e4503ce2d064 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027390 Jul 28 17:37:20.502725 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 15/29] 10.222.0.89 () {64 vars in 1332 bytes} [Thu Jul 28 17:37:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:22.743075 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-733065d7-b0b1-4dc2-98eb-8c4074ca02f3 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:22.744692 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-733065d7-b0b1-4dc2-98eb-8c4074ca02f3 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Jul 28 17:37:22.745085 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 15/30] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:23.248178 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-2b7d5b77-d56d-4a0d-ab0c-21b8da9822ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:23.274909 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-2b7d5b77-d56d-4a0d-ab0c-21b8da9822ba admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.523839 Jul 28 17:37:23.276073 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 16/31] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:23.288628 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-3abea19a-f517-470f-8662-df9013e35511 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:23.321585 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-3abea19a-f517-470f-8662-df9013e35511 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037071 Jul 28 17:37:23.322757 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 16/32] 10.222.0.89 () {64 vars in 1332 bytes} [Thu Jul 28 17:37:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:25.640985 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-2b7d5b77-d56d-4a0d-ab0c-21b8da9822ba admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:25.642072 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-2b7d5b77-d56d-4a0d-ab0c-21b8da9822ba admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 28 17:37:25.644632 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 17/33] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:26.107237 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:26.130059 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.479930 Jul 28 17:37:26.131021 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 17/34] 10.222.0.89 () {64 vars in 1282 bytes} [Thu Jul 28 17:37:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:26.144089 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-1d876da0-4e55-4c15-9266-f235d4ba31f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:26.148988 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:37:26.173752 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-1d876da0-4e55-4c15-9266-f235d4ba31f9 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034264 Jul 28 17:37:26.174359 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 18/35] 10.222.0.89 () {64 vars in 1332 bytes} [Thu Jul 28 17:37:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:37:46.211556 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:46.212567 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 17:37:46.212965 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 18/36] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:46.604006 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-f72036b3-0381-48e1-9da6-4ce6b2a4b4e0 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:46.622380 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-f72036b3-0381-48e1-9da6-4ce6b2a4b4e0 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403531 Jul 28 17:37:46.622963 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 19/37] 10.222.0.89 () {60 vars in 1291 bytes} [Thu Jul 28 17:37:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:37:47.715261 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:47.716253 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-900b39e3-239f-42a8-b7ba-2c65dd218fb4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 28 17:37:47.716650 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 19/38] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:48.298535 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91ba232f-f88f-4648-b0f8-7379ce72dcd8 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:48.304413 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.wsgi [None req-91ba232f-f88f-4648-b0f8-7379ce72dcd8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91ba232f-f88f-4648-b0f8-7379ce72dcd8 admin admin] Request method failure captured: Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept: application/json Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept-Encoding: gzip, deflate Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Connection: keep-alive Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Content-Length: 0 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Host: 10.222.0.89 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-System-Scope: None Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: User-Agent: python-novaclient Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Auth-Token: gAAAAABi4slreaxyGzF5YK5Cu0JaNSpfzPnLvYZoC5B9ii-Iy0EOl1ztCf73CeHjRwofl5RjOts5X6enlUZ-i_v2244ukgEuoMXTDajx31wwfJ2_6RsbVFR1tZquRBElLX_ZFcfLi2SxDX9SztpfCSOIS-VGNK8W7TdYzqtlbk7GpiNgwuEpOF4 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Id: None Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Name: None Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Identity-Status: Confirmed Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Is-Admin-Project: True Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Id: default Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Name: Default Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Name: admin Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Role: member,reader,admin Jul 28 17:37:48.307718 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Roles: member,reader,admin Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant: admin Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Name: admin Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User: admin Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Id: default Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Name: Default Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Name: admin Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: method: > Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: exception: Flavor 42 could not be found. Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: action_args: {'id': '42'} Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:48.309182 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:48.311028 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.312236 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91ba232f-f88f-4648-b0f8-7379ce72dcd8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:48.313389 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-91ba232f-f88f-4648-b0f8-7379ce72dcd8 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.435360 Jul 28 17:37:48.313389 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 20/39] 10.222.0.89 () {60 vars in 1190 bytes} [Thu Jul 28 17:37:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:37:48.319439 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-3627f2a2-d0f0-436e-b2e4-d87826b4477d admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:48.323591 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:37:48.344655 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-3627f2a2-d0f0-436e-b2e4-d87826b4477d admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028814 Jul 28 17:37:48.345434 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 20/40] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:37:48.355376 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-e795fcf1-3841-4060-95a2-ea080d0cb166 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:48.380825 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-e795fcf1-3841-4060-95a2-ea080d0cb166 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029023 Jul 28 17:37:48.381400 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 21/41] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:37:48.391539 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-290a05e2-98d0-4902-a0e1-89fec6374c4e admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:48.398645 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.wsgi [None req-290a05e2-98d0-4902-a0e1-89fec6374c4e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-290a05e2-98d0-4902-a0e1-89fec6374c4e admin admin] Request method failure captured: Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept: application/json Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept-Encoding: gzip, deflate Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Connection: keep-alive Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Content-Length: 0 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Host: 10.222.0.89 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-System-Scope: None Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: User-Agent: python-novaclient Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Auth-Token: gAAAAABi4slreaxyGzF5YK5Cu0JaNSpfzPnLvYZoC5B9ii-Iy0EOl1ztCf73CeHjRwofl5RjOts5X6enlUZ-i_v2244ukgEuoMXTDajx31wwfJ2_6RsbVFR1tZquRBElLX_ZFcfLi2SxDX9SztpfCSOIS-VGNK8W7TdYzqtlbk7GpiNgwuEpOF4 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Id: None Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Name: None Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Identity-Status: Confirmed Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Is-Admin-Project: True Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Id: default Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Name: Default Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Name: admin Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Role: member,reader,admin Jul 28 17:37:48.402034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Roles: member,reader,admin Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant: admin Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Name: admin Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User: admin Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Id: default Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Name: Default Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Name: admin Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: method: > Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: exception: Flavor 42 could not be found. Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: action_args: {'id': '42'} Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:48.403593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:48.404593 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:48.405751 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-290a05e2-98d0-4902-a0e1-89fec6374c4e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:48.406767 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-290a05e2-98d0-4902-a0e1-89fec6374c4e admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016009 Jul 28 17:37:48.406767 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 21/42] 10.222.0.89 () {60 vars in 1190 bytes} [Thu Jul 28 17:37:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:37:49.371764 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-e795fcf1-3841-4060-95a2-ea080d0cb166 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:49.372777 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-e795fcf1-3841-4060-95a2-ea080d0cb166 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 28 17:37:49.373207 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 22/43] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:49.904338 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-9b2e6f5f-59db-43f1-b9f9-ce2da4a10adb admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:49.910206 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.wsgi [None req-9b2e6f5f-59db-43f1-b9f9-ce2da4a10adb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-9b2e6f5f-59db-43f1-b9f9-ce2da4a10adb admin admin] Request method failure captured: Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept: application/json Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept-Encoding: gzip, deflate Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Connection: keep-alive Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Content-Length: 0 Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Host: 10.222.0.89 Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-System-Scope: None Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: User-Agent: python-novaclient Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Auth-Token: gAAAAABi4sltHdUk3gK385DXapuDSKXQtIwKUxgr7FLW0I5DCRKM9HmM0Wx6t58deqNtBEgsrsJ-qwtpKsGVyx4FRDp9dRBgnecBxLwY2Opmg3Rz9_bkAS0O6wfZcH6zJXQzmpninuZ0pfZycB0GiEQ_3tYjDi3u3Bk1HYfJCE_MsyCnZGwvWVI Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Id: None Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Name: None Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Identity-Status: Confirmed Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Is-Admin-Project: True Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Id: default Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Name: Default Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Name: admin Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Role: member,reader,admin Jul 28 17:37:49.911697 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Roles: member,reader,admin Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant: admin Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Name: admin Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User: admin Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Id: default Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Name: Default Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Name: admin Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: method: > Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: exception: Flavor 84 could not be found. Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: action_args: {'id': '84'} Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:49.913310 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:49.914481 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.916151 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-9b2e6f5f-59db-43f1-b9f9-ce2da4a10adb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:49.917615 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-9b2e6f5f-59db-43f1-b9f9-ce2da4a10adb admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400620 Jul 28 17:37:49.917615 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 22/44] 10.222.0.89 () {60 vars in 1190 bytes} [Thu Jul 28 17:37:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 17:37:49.922892 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-ed08719a-e771-44b5-a844-66d87cab1137 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:49.937903 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-ed08719a-e771-44b5-a844-66d87cab1137 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018620 Jul 28 17:37:49.938435 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 23/45] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:37:49.948445 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-19dbc511-774b-4fb2-a12d-e5a9e7b2abad admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:49.966080 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-19dbc511-774b-4fb2-a12d-e5a9e7b2abad admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021117 Jul 28 17:37:49.967117 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 23/46] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:37:49.976523 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-8f4dfe48-1cc5-4a8f-991c-680e18d8b4ef admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:49.982022 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.wsgi [None req-8f4dfe48-1cc5-4a8f-991c-680e18d8b4ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-8f4dfe48-1cc5-4a8f-991c-680e18d8b4ef admin admin] Request method failure captured: Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept: application/json Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept-Encoding: gzip, deflate Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Connection: keep-alive Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Content-Length: 0 Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Host: 10.222.0.89 Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-System-Scope: None Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: User-Agent: python-novaclient Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Auth-Token: gAAAAABi4sltHdUk3gK385DXapuDSKXQtIwKUxgr7FLW0I5DCRKM9HmM0Wx6t58deqNtBEgsrsJ-qwtpKsGVyx4FRDp9dRBgnecBxLwY2Opmg3Rz9_bkAS0O6wfZcH6zJXQzmpninuZ0pfZycB0GiEQ_3tYjDi3u3Bk1HYfJCE_MsyCnZGwvWVI Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Id: None Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Name: None Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Identity-Status: Confirmed Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Is-Admin-Project: True Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Id: default Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Name: Default Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Name: admin Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Role: member,reader,admin Jul 28 17:37:49.983702 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Roles: member,reader,admin Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant: admin Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Name: admin Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User: admin Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Id: default Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Name: Default Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Name: admin Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: method: > Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: exception: Flavor 84 could not be found. Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: action_args: {'id': '84'} Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:49.985404 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:49.987455 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:49.988768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-8f4dfe48-1cc5-4a8f-991c-680e18d8b4ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:49.990287 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-8f4dfe48-1cc5-4a8f-991c-680e18d8b4ef admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011975 Jul 28 17:37:49.990287 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 24/47] 10.222.0.89 () {60 vars in 1190 bytes} [Thu Jul 28 17:37:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 17:37:50.956745 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-19dbc511-774b-4fb2-a12d-e5a9e7b2abad admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:50.957875 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-19dbc511-774b-4fb2-a12d-e5a9e7b2abad admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 28 17:37:50.958276 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 24/48] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:51.496000 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91506735-92bf-45a5-a095-9abd59d15d77 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:51.502521 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.wsgi [None req-91506735-92bf-45a5-a095-9abd59d15d77 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91506735-92bf-45a5-a095-9abd59d15d77 admin admin] Request method failure captured: Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept: application/json Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Accept-Encoding: gzip, deflate Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Connection: keep-alive Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Content-Length: 0 Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Host: 10.222.0.89 Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Openstack-System-Scope: None Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: User-Agent: python-novaclient Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Auth-Token: gAAAAABi4sluCVdHFjvyfAA1Xqd-ay6HbjmcD-JP1NU1lja3DO05XIJrHO6zN1nU5so5vWZgy7e2lII9gOL95R3zUliFj7zRoyLc1CeLaRWDx8ruar5B-6QlhbbaC5WpJkCtPCfVAO62N42_E272sJSb-8ZuqInUj7RFrAYVXLvpm541z4FBc8w Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Id: None Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Domain-Name: None Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Identity-Status: Confirmed Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Is-Admin-Project: True Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Id: default Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Domain-Name: Default Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Project-Name: admin Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Role: member,reader,admin Jul 28 17:37:51.504029 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Roles: member,reader,admin Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant: admin Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-Tenant-Name: admin Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User: admin Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Id: default Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Domain-Name: Default Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: X-User-Name: admin Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: method: > Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: exception: Flavor 451 could not be found. Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: action_args: {'id': '451'} Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:51.505660 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:51.506675 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.508300 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-91506735-92bf-45a5-a095-9abd59d15d77 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:51.509669 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-91506735-92bf-45a5-a095-9abd59d15d77 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.407546 Jul 28 17:37:51.509669 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 25/49] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:37:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:37:51.516343 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-00c7f05c-f20d-436d-a82b-5293bc8990a4 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:51.536589 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-00c7f05c-f20d-436d-a82b-5293bc8990a4 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024686 Jul 28 17:37:51.537176 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 25/50] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:37:51.548141 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:51.563599 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019649 Jul 28 17:37:51.564281 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 26/51] 10.222.0.89 () {60 vars in 1210 bytes} [Thu Jul 28 17:37:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:37:51.573603 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-bd4eb85a-5fc8-433b-b16f-bf530743f825 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:51.578986 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.wsgi [None req-bd4eb85a-5fc8-433b-b16f-bf530743f825 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-bd4eb85a-5fc8-433b-b16f-bf530743f825 admin admin] Request method failure captured: Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept: application/json Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Accept-Encoding: gzip, deflate Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Connection: keep-alive Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Content-Length: 0 Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Host: 10.222.0.89 Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-Api-Version: compute 2.90 Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Openstack-System-Scope: None Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: User-Agent: python-novaclient Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Auth-Token: gAAAAABi4sluCVdHFjvyfAA1Xqd-ay6HbjmcD-JP1NU1lja3DO05XIJrHO6zN1nU5so5vWZgy7e2lII9gOL95R3zUliFj7zRoyLc1CeLaRWDx8ruar5B-6QlhbbaC5WpJkCtPCfVAO62N42_E272sJSb-8ZuqInUj7RFrAYVXLvpm541z4FBc8w Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Id: None Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Domain-Name: None Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Identity-Status: Confirmed Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Is-Admin-Project: True Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Id: default Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Domain-Name: Default Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Project-Name: admin Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Role: member,reader,admin Jul 28 17:37:51.581188 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Roles: member,reader,admin Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_d68024df9ad444518749a9b417c3b67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/d68024df9ad444518749a9b417c3b67b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant: admin Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Id: d68024df9ad444518749a9b417c3b67b Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-Tenant-Name: admin Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User: admin Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Id: default Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Domain-Name: Default Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Id: bbc7ab320041413396df1eef4db728ae Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: X-User-Name: admin Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: method: > Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: exception: Flavor 451 could not be found. Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: action_args: {'id': '451'} Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:37:51.582790 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:51.583849 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: ERROR nova.api.openstack.wsgi Jul 28 17:37:51.585193 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-bd4eb85a-5fc8-433b-b16f-bf530743f825 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:37:51.586460 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-bd4eb85a-5fc8-433b-b16f-bf530743f825 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012474 Jul 28 17:37:51.586460 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 26/52] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:37:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:37:52.557081 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:52.558113 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 28 17:37:52.558508 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 27/53] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:53.087271 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-76201af6-9d0c-4518-814d-9ca3053a5204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:53.106206 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-76201af6-9d0c-4518-814d-9ca3053a5204 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407926 Jul 28 17:37:53.106764 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 27/54] 10.222.0.89 () {64 vars in 1235 bytes} [Thu Jul 28 17:37:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:54.086201 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:54.087228 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 17:37:54.087625 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 28/55] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:54.635926 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-d69ab49c-ead3-446b-b319-6c08d1aa8b2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:54.654823 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-d69ab49c-ead3-446b-b319-6c08d1aa8b2c admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.419638 Jul 28 17:37:54.655307 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 28/56] 10.222.0.89 () {64 vars in 1235 bytes} [Thu Jul 28 17:37:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:55.628623 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:55.629761 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 28 17:37:55.630170 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 29/57] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:56.162033 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-3da36594-51e2-424d-82ee-c52dc319c95a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:56.181666 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-3da36594-51e2-424d-82ee-c52dc319c95a admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.413643 Jul 28 17:37:56.182208 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 29/58] 10.222.0.89 () {64 vars in 1235 bytes} [Thu Jul 28 17:37:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:37:57.157772 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:57.158768 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 28 17:37:57.159161 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 30/59] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:57.706586 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-3c3ab81b-28bd-47f0-a80f-8a000ef74068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:37:57.728027 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-3c3ab81b-28bd-47f0-a80f-8a000ef74068 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.430647 Jul 28 17:37:57.728581 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 30/60] 10.222.0.89 () {64 vars in 1235 bytes} [Thu Jul 28 17:37:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:37:58.706977 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:58.708004 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 17:37:58.708402 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 31/61] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:37:59.240034 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-3e13573f-a03f-4c7b-8ae1-0a85aa7c18c0 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:37:59.261299 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-3e13573f-a03f-4c7b-8ae1-0a85aa7c18c0 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415395 Jul 28 17:37:59.261836 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 31/62] 10.222.0.89 () {60 vars in 1202 bytes} [Thu Jul 28 17:37:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:38:51.091120 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.092756 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-d1a877ee-dce3-44c9-b07a-022fc4bb4c33 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jul 28 17:38:51.093543 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 32/63] 10.222.0.89 () {54 vars in 930 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:38:51.103509 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:38:51.487734 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-f475f9c2-adec-4d38-b92f-d7d6c71467c0 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.508972 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-f475f9c2-adec-4d38-b92f-d7d6c71467c0 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409791 Jul 28 17:38:51.509463 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 32/64] 10.222.0.89 () {60 vars in 1291 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:38:51.532600 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-8e6fe457-f173-444d-b556-7fc8ad04ecd5 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.536032 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG dbcounter [-] [109985] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:38:51.542256 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-8e6fe457-f173-444d-b556-7fc8ad04ecd5 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013409 Jul 28 17:38:51.542790 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 33/65] 10.222.0.89 () {60 vars in 1282 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:38:51.555642 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-5fcb2a18-63b8-4f8f-81f5-3665cf001472 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.564015 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-5fcb2a18-63b8-4f8f-81f5-3665cf001472 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012023 Jul 28 17:38:51.564540 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 33/66] 10.222.0.89 () {60 vars in 1285 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:38:51.575948 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.584993 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012719 Jul 28 17:38:51.585567 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 34/67] 10.222.0.89 () {60 vars in 1285 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:38:51.597008 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-26153548-5fd9-422d-b734-49c6ffa8c87c admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:38:51.604629 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-26153548-5fd9-422d-b734-49c6ffa8c87c admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011163 Jul 28 17:38:51.605144 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 34/68] 10.222.0.89 () {60 vars in 1282 bytes} [Thu Jul 28 17:38:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:23.565740 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:23.566743 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 28 17:42:23.567141 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 35/69] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:42:23.711200 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_api:SELECT=6 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:23.874306 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:23.876632 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:42:23.876632 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:42:23.877978 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:23.878415 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:23.879238 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:23.879647 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:23.914288 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-53a4d547-c50c-4273-aa67-7fe23e765a45 admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204417 Jul 28 17:42:23.914835 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 35/70] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:42:23 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:24.747233 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:24.748230 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 28 17:42:24.748627 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 36/71] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:42:24.939693 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:24.942114 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:42:24.942114 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:42:24.943292 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:24.943727 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:24.944497 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:24.944916 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:24.965134 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-cf811389-ad41-499f-ba44-48995cc6e6cf admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078225 Jul 28 17:42:24.965641 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 36/72] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:42:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:36.218785 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:36.219787 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jul 28 17:42:36.220185 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 37/73] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:42:36.363005 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_cell0:SELECT=4 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.363808 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_cell1:SELECT=4 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.364564 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG dbcounter [-] [109984] Writing DB stats nova_api:SELECT=8 {{(pid=109984) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.413514 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:36.415988 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:42:36.415988 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:42:36.417379 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:36.417817 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:36.418581 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:36.419004 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:36.444935 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-b1e3e47f-1915-4942-93e7-79a573323b95 admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086699 Jul 28 17:42:36.445525 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 37/74] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:42:36 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:42:37.301635 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: DEBUG nova.api.openstack.wsgi [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] Calling method '>' {{(pid=109985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:37.302644 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: INFO nova.api.openstack.requestlog [None req-3658b891-1332-4e97-a832-adc0e5054534 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 28 17:42:37.303023 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: [pid: 109985|app: 0|req: 38/75] 10.222.0.89 () {56 vars in 1074 bytes} [Thu Jul 28 17:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:42:37.496637 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG nova.api.openstack.wsgi [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] Calling method '>' {{(pid=109984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:42:37.499715 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:42:37.499715 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: warnings.warn(msg) Jul 28 17:42:37.500896 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:37.501538 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:37.502328 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:42:37.502754 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: DEBUG oslo_concurrency.lockutils [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:42:37.524312 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: INFO nova.api.openstack.requestlog [None req-e80957cb-5d2f-4c98-b8b4-7364696e4ea9 admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079245 Jul 28 17:42:37.524791 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: [pid: 109984|app: 0|req: 38/76] 10.222.0.89 () {60 vars in 1193 bytes} [Thu Jul 28 17:42:37 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:43:34.183897 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: Thu Jul 28 17:43:34 2022 - graceful shutdown triggered... Jul 28 17:43:34.184431 dv-cinder-813229-13-iscsi devstack@n-api.service[109984]: Gracefully killing worker 1 (pid: 109984)... Jul 28 17:43:34.184020 dv-cinder-813229-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 17:43:34.185275 dv-cinder-813229-13-iscsi devstack@n-api.service[109985]: Gracefully killing worker 2 (pid: 109985)... Jul 28 17:43:35.184379 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: worker 1 buried after 1 seconds Jul 28 17:43:35.184918 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: worker 2 buried after 1 seconds Jul 28 17:43:35.184918 dv-cinder-813229-13-iscsi devstack@n-api.service[109983]: goodbye to uWSGI. Jul 28 17:43:35.185959 dv-cinder-813229-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 17:43:35.186508 dv-cinder-813229-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 17:43:35.190102 dv-cinder-813229-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 17:43:35.201088 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:43:35 2022] *** Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: nodename: dv-cinder-813229-13-iscsi Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: machine: x86_64 Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: clock source: unix Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: pcre jit disabled Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: detected number of CPU cores: 4 Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: current working directory: / Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:43:35.203139 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: your processes number limit is 47680 Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: your memory page size is 4096 bytes Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: detected max file descriptor number: 2048 Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: lock engine: pthread robust mutexes Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: thunder lock: enabled Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 17:43:35.203961 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:43:35.242526 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: Python main interpreter initialized at 0x55cfb0e279c0 Jul 28 17:43:35.242526 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: python threads support enabled Jul 28 17:43:35.242526 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: your server socket listen backlog is limited to 100 connections Jul 28 17:43:35.242526 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:43:35.243114 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:43:35.243114 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: *** Operational MODE: preforking *** Jul 28 17:43:35.243369 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:43:35.243369 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: spawned uWSGI master process (pid: 124504) Jul 28 17:43:35.243410 dv-cinder-813229-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 17:43:35.243967 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: spawned uWSGI worker 1 (pid: 124515, cores: 1) Jul 28 17:43:35.249247 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: spawned uWSGI worker 2 (pid: 124516, cores: 1) Jul 28 17:43:35.249247 dv-cinder-813229-13-iscsi devstack@n-api.service[124504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:43:35.926867 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:43:35.959944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:43:37.095237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:37.095237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: from cryptography.utils import int_from_bytes Jul 28 17:43:37.096657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:37.096657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: from cryptography.utils import int_from_bytes Jul 28 17:43:37.125374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:37.125374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: from cryptography.utils import int_from_bytes Jul 28 17:43:37.126087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:43:37.126087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: from cryptography.utils import int_from_bytes Jul 28 17:43:39.517484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:43:39.518099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:43:39.518417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:43:39.518634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:43:39.518896 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:43:39.519287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.519617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.519940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.520260 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.520594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.520906 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.521256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.521580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.521911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.522174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.522489 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.522817 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-13-iscsi {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.523141 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.523647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.523965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.524288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.524598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.524927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.525278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.525781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.526133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:43:39.526528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:43:39.527048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:43:39.527346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.527463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:43:39.527662 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:43:39.527790 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528001 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.528962 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.529209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.529437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.529654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.529879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.530098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.530330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.530554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.530774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531318 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-13-iscsi {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.531993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.532425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.532648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.532865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-13-iscsi {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.532865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.533343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.533568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.533761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.533920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.534924 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535086 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535262 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.535947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536100 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536309 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.536949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537794 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.537940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.538093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.538251 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.538455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.538615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.538921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.539804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.539965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-13-iscsi {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.540763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541561 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.541885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.542975 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543133 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543285 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.543909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544212 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.544989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.545135 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.545317 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.545550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.545700 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.545853 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.546869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547025 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547399 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.547883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.548872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.549046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.549954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.550926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551230 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.551855 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552212 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552825 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.552987 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.553633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554060 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554831 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.554979 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.555918 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.556589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.556685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.556763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.556853 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.556933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557210 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557693 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.557931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558014 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558249 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558406 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.558940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559174 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559257 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559625 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.559936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560332 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560405 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560553 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560702 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560774 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560844 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560915 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.560992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.561070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.561170 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.561259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.561340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.561890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.562022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.562651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.562779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.562898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563391 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563507 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563618 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.563980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.564099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.564231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.564343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.564463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.564586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.564778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.564907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.565152 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.565498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.565838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.566051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.566164 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.566462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.566695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.566856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.567004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.567166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.567321 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.567473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.567647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.567866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.568035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.568189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.568335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.568478 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.568621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.568764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.568923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.569085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.569282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.569439 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.569592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.569746 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.569905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.570068 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.570220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.570372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.570517 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.570667 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.570821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.570973 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.571117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.571268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.571419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.571602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.571829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.571985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.572148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.572300 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.572444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:43:39.572597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.572748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.572898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573058 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573532 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.573985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574141 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574292 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574600 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.574895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.575039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.575224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.575784 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.576115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.576440 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.576601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.576757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.576908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.577059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.577279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.577430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.577580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.577754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.578422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.578796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.578980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579314 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579788 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.579932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580227 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.580824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.581112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.581289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.581443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.581606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.581750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.582975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583559 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.583996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584742 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.584899 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.585086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.585312 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.585312 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.585971 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.586280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.586633 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.586803 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.586949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.587961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.588873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589338 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.589942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590239 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.590980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591136 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.591912 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592308 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592612 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.592907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593396 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.593971 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.594961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.595113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.595268 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.595471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.595709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.596094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.596420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.596420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.596908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597249 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597576 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.597723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598003 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598154 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598459 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598610 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.598898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.599959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.600850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.601988 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602149 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.602972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.603874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604025 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.604918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.605080 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.605244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.605444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.605595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.605830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.606006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.606359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.606641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.606983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.606983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.607289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.608336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.608509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.608670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.608831 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.609015 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.609290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.609617 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.609829 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.609989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.610897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611351 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611502 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.611961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.612965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.613865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.614868 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.615814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.616184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.616786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.616940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.617309 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.617461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.617629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.617774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.617928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.618844 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.619976 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620636 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.620942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.621928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622389 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.622943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623111 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623190 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623190 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623546 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.623989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624339 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.624520 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625592 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.625983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626170 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.626959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627824 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.627991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628692 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.628857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629731 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629832 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.629925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630019 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.630917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.631794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632017 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.632990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.633938 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.634155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.634246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.634471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.634732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.634832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635069 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.635809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636317 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.636982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.637923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638559 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.638966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639180 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639792 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.639885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.640095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.640273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641152 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.641872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642188 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642493 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.642978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.643913 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.644850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645013 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.645824 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646464 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.646932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.647926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648191 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.648944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649446 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.649850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.650981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651082 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651387 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.651914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.652938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653140 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653267 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653558 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.653865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654171 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.654984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655392 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655592 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.655909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.656900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.657006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.657194 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.657502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.657894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.658094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.658253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.658411 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.658721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.659047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.659365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.659670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.659981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.660285 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.660475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.660638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.660797 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.660949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661149 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661832 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.661982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662762 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.662913 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663553 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.663896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664101 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664529 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.664843 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665111 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.665892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666100 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.666837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667052 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667161 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.667802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668585 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.668984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669864 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.669963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.670921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.671127 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.671226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.671437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.672045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.672263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.672538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.672661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.672893 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673342 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.673992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.674926 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675587 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.675916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676205 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676540 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676834 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.676999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677793 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.677945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.678997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679684 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.679990 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680298 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680836 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.680935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681273 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.681904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682537 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.682867 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683175 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.683886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684206 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.684978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.685237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.685347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.685569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.685662 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.685879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686198 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686515 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.686970 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.687113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688218 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.688992 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689340 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.689958 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690496 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.690999 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691644 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.691974 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692285 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692385 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692687 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.692908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.693009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.693242 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.693434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.693763 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.693871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694073 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694175 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.694812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695326 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.695939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696341 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.696970 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697194 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697510 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.697939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698176 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.698874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699175 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699367 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.699997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700100 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700317 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.700947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701042 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701392 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701893 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.701985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.702200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.702308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.702545 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.702639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.702877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.703856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704581 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.704900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705234 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705784 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.705882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706492 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.706802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.707916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708446 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.708962 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709300 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.709916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710124 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710523 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.710828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.711775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712003 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712095 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.712955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713394 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.713921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.714965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.715180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.715427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.715527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.715792 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.715890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716101 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.716826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.717964 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.718994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719156 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.719851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720084 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720724 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.720836 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.721833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722163 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.722790 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.723949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724052 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.724989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.725942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.726161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.726287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.726957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727346 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.727988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.728240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.728337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.728560 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.728666 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.728895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.729894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730179 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730859 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.730994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.731873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.732999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.733256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.733356 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.733614 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.733718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.733884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.734652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.734858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735547 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735660 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.735945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.736228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.736336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.736732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.736826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737730 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.737867 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.738044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.738200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.738369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.738523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.738864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.739854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740011 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740155 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740409 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.740916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.741973 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742181 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.742885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743102 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743507 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.743812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.744937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745362 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745576 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.745981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.746193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.746287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.746501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.746669 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.746897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.747912 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.748961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.749079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.749227 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.749452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.749598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.750488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.750721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.750870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.751947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.752169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.752387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.752517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.752732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.752860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.753877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.754118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.754254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.754367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.754478 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.754823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.755156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.755476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.755825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.755962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756714 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.756866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.757105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.757261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.757630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.757740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.757947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758262 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.758894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759298 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.759923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760241 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760492 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760633 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.760921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761472 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761589 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.761886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.762878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.763837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.764995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.765119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.765267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.765604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.765754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.765855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766500 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.766954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.767923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.768955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.769946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770058 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770265 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.770909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.771956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772464 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772771 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.772867 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773213 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773492 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.773845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.774936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775569 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775709 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.775991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776433 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776575 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.776862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777218 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777700 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.777988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.778956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.779914 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.780921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781752 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.781972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.782907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783011 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.783970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.784201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.784294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.784521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.784628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.784843 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785392 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785591 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.785908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.786830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787670 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787764 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.787982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.788932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789040 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.789927 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790677 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.790933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791357 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.791916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792019 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792234 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.792956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:43:39.793099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:43:39.793224 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:43:39.856461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO dbcounter [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Registered counter for database nova_api Jul 28 17:43:39.857537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO dbcounter [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Registered counter for database nova_api Jul 28 17:43:39.880096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_db.sqlalchemy.engines [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:39.881266 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_db.sqlalchemy.engines [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:39.887449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writer thread running {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:39.888409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writer thread running {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:39.945635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.context [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c442d92-b981-4069-943a-49d075b5aed3(cell1) {{(pid=124516) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:43:39.947608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.context [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c442d92-b981-4069-943a-49d075b5aed3(cell1) {{(pid=124515) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:43:39.949794 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:43:39.951376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:43:39.951693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:43:39.955011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:43:39.955112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:43:39.955112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:43:39.955278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:43:39.956641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:43:39.956755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO dbcounter [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Registered counter for database nova_cell0 Jul 28 17:43:39.958679 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO dbcounter [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Registered counter for database nova_cell0 Jul 28 17:43:39.960956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO dbcounter [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Registered counter for database nova_cell1 Jul 28 17:43:39.962732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO dbcounter [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Registered counter for database nova_cell1 Jul 28 17:43:39.967977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_db.sqlalchemy.engines [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:39.970716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_db.sqlalchemy.engines [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:39.973704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writer thread running {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:39.975706 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writer thread running {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:39.976379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_db.sqlalchemy.engines [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:40.121073 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_db.sqlalchemy.engines [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:40.122074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writer thread running {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:40.126346 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writer thread running {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:40.133882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO dbcounter [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Registered counter for database nova_cell0 Jul 28 17:43:40.138164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO dbcounter [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Registered counter for database nova_cell0 Jul 28 17:43:40.140850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_db.sqlalchemy.engines [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:40.146013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writer thread running {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:40.146184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_db.sqlalchemy.engines [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:43:40.151020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writer thread running {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:43:40.466566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: WARNING keystonemiddleware.auth_token [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:43:40.474643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: WARNING keystonemiddleware.auth_token [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:43:40.474838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: WARNING keystonemiddleware.auth_token [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:43:40.482074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: WARNING keystonemiddleware.auth_token [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:43:40.818276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: WARNING keystonemiddleware.auth_token [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:43:40.824447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: WARNING keystonemiddleware.auth_token [None req-59f42508-44bb-4134-a424-21318cf7b85a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:43:40.827313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: WARNING keystonemiddleware.auth_token [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:43:40.830432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cfb0e279c0 pid: 124515 (default app) Jul 28 17:43:40.834051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: WARNING keystonemiddleware.auth_token [None req-80f0aa66-2ce3-4bb5-8d81-2573baba79c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:43:40.839367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cfb0e279c0 pid: 124516 (default app) Jul 28 17:44:22.879508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.882099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.883474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:22.884636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.350176 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.351340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.352518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:23.353678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.078483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-548401cf-e34a-4535-bf40-eaf3eed8dc9c tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Action: 'create', calling method: .version_select at 0x7fce3c82dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1757133599"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:24.302223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d70fc12-7daf-4f4d-858a-89a5f3475a34 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Action: 'create', calling method: .version_select at 0x7fce3c82eca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-803517799", "metadata": {"Type": "work"}}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d70fc12-7daf-4f4d-858a-89a5f3475a34 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 121 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:24.309382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-803517799", "metadata": {"Type": "work"}}} Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:24.311119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-803517799', 'metadata': {'Type': 'work'}}}} Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise error Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:24.312306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 17:44:24.314180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 17:44:24.315590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 17:44:24.315590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.319610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d70fc12-7daf-4f4d-858a-89a5f3475a34 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:24.321281 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7d70fc12-7daf-4f4d-858a-89a5f3475a34 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.984109 Jul 28 17:44:24.323797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 1/1] 10.222.0.89 () {60 vars in 1156 bytes} [Thu Jul 28 17:44:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 989 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:44:24.342807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5be43a65-3278-4a59-85fc-c63c8c5dccf1 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Action: 'create', calling method: .version_select at 0x7fce3c709790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-387263903", "metadata": {"Type": "work"}}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5be43a65-3278-4a59-85fc-c63c8c5dccf1 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 119 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:24.350543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-387263903", "metadata": {"Type": "work"}}} Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:24.353040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-387263903', 'metadata': {'Type': 'work'}}}} Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise error Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi '0' Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:24.354018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 17:44:24.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 17:44:24.356867 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 17:44:24.356867 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.358475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5be43a65-3278-4a59-85fc-c63c8c5dccf1 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:24.359807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5be43a65-3278-4a59-85fc-c63c8c5dccf1 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027188 Jul 28 17:44:24.360824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 2/2] 10.222.0.89 () {60 vars in 1156 bytes} [Thu Jul 28 17:44:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:44:24.372495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-03ae9813-d1e6-4fab-b070-e8d54221647b tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Action: 'create', calling method: .version_select at 0x7fce3c6e5820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-189501101", "metadata": {"Type": "work"}}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-03ae9813-d1e6-4fab-b070-e8d54221647b tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 118 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:24.380841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-189501101", "metadata": {"Type": "work"}}} Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:24.382366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-189501101', 'metadata': {'Type': 'work'}}}} Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise error Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi '' Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:24.383162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 17:44:24.385888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 17:44:24.394320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 17:44:24.394320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:24.394320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-03ae9813-d1e6-4fab-b070-e8d54221647b tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:24.394320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-03ae9813-d1e6-4fab-b070-e8d54221647b tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018314 Jul 28 17:44:24.394320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 3/3] 10.222.0.89 () {60 vars in 1156 bytes} [Thu Jul 28 17:44:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 17:44:24.399773 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0147d53c-0dd1-40fc-98e7-4c0fc00f3a85 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Calling method '.version_select at 0x7fce3c6e5550>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:25.091302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-0147d53c-0dd1-40fc-98e7-4c0fc00f3a85 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] HTTP exception thrown: Volume tempest-invalid-2035735164 could not be found. Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0147d53c-0dd1-40fc-98e7-4c0fc00f3a85 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2035735164 HTTP/1.1 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:25.095431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Volume tempest-invalid-2035735164 could not be found. Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'tempest-invalid-2035735164'} Jul 28 17:44:25.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2035735164 could not be found. (HTTP 404) (Request-ID: req-482da84c-7acf-47ae-8db5-c3823afc921b) Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.097543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:25.098690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2035735164 could not be found. Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:25.099947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2035735164 could not be found. Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2035735164 could not be found. Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0147d53c-0dd1-40fc-98e7-4c0fc00f3a85 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 404 to user: Volume tempest-invalid-2035735164 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0147d53c-0dd1-40fc-98e7-4c0fc00f3a85 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2035735164" status: 404 len: 99 microversion: 2.1 time: 0.702438 Jul 28 17:44:25.101090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 4/4] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:44:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2035735164 => generated 99 bytes in 704 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 17:44:25.110133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e6eb9074-fe2c-4289-a1dc-f6989a838ca0 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004788 Jul 28 17:44:25.110656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 5/5] 10.222.0.89 () {58 vars in 1140 bytes} [Thu Jul 28 17:44:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 17:44:25.121465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-47b860fb-c004-44f1-9cc5-2f5d96349eff tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003858 Jul 28 17:44:25.125637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 6/6] 10.222.0.89 () {58 vars in 1137 bytes} [Thu Jul 28 17:44:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 17:44:25.133565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3377f2cd-3b60-4344-995d-9d52b1f372a3 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Calling method '.version_select at 0x7fce3c616af0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:25.693029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-3377f2cd-3b60-4344-995d-9d52b1f372a3 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] HTTP exception thrown: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3377f2cd-3b60-4344-995d-9d52b1f372a3 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/os-volumes/97bcb183-bc1a-425e-bd22-8b817c9c45ad HTTP/1.1 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:25.695165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '97bcb183-bc1a-425e-bd22-8b817c9c45ad'} Jul 28 17:44:25.696527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. (HTTP 404) (Request-ID: req-1ebed7d1-88df-40ce-be2c-31d6bda7860e) Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.698152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:25.701467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 17:44:25.705716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3377f2cd-3b60-4344-995d-9d52b1f372a3 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 404 to user: Volume 97bcb183-bc1a-425e-bd22-8b817c9c45ad could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3377f2cd-3b60-4344-995d-9d52b1f372a3 tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/97bcb183-bc1a-425e-bd22-8b817c9c45ad" status: 404 len: 109 microversion: 2.1 time: 0.567009 Jul 28 17:44:25.709899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 7/7] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:44:25 2022] DELETE /compute/v2.1/os-volumes/97bcb183-bc1a-425e-bd22-8b817c9c45ad => generated 109 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:25.713909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c7d62c7a-1ca5-4dd4-b3b7-a4efb01c4a0d tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Calling method '.version_select at 0x7fce3c616b80>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:25.771868 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-548401cf-e34a-4535-bf40-eaf3eed8dc9c tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.912921 Jul 28 17:44:25.772676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 1/8] 10.222.0.89 () {60 vars in 1155 bytes} [Thu Jul 28 17:44:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2916 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 17:44:25.789874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6c92bf8e-9ea5-4ffd-b47b-0ef62869f908 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c688b80>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:25.838547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-c7d62c7a-1ca5-4dd4-b3b7-a4efb01c4a0d tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] HTTP exception thrown: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c7d62c7a-1ca5-4dd4-b3b7-a4efb01c4a0d tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Request method failure captured: Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/os-volumes/677964b5-539c-4b55-8f5c-dac0fcf13f27 HTTP/1.1 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sr3QEsAAWRd8GjGKIRCsO4JQSJk2czC_mF3IQZXmHv2q9esvnmahl4VF6RG7LXPop_TEei_28UL0v0tMMdVZvFLPTPLPEKQOsP4iH7oyCAZRrDV3i1eKAOjxq_-j_XbgE6-1WVHzEGxCjGFey--dy1gzbHZp0DqWXcaLxgywV2OGO8 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:44:25.840546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/29887ef23f954dc18aea8bd7e847cabc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 29887ef23f954dc18aea8bd7e847cabc Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-1608732781 Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0d61a50992b241efbad5af3ece48a8ea Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-1608732781-project Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '677964b5-539c-4b55-8f5c-dac0fcf13f27'} Jul 28 17:44:25.842329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. (HTTP 404) (Request-ID: req-cbd531db-c2b0-4355-80bc-4ff9fb5a0934) Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.843895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:25.845369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 17:44:25.846729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:44:25.848129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c7d62c7a-1ca5-4dd4-b3b7-a4efb01c4a0d tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] Returning 404 to user: Volume 677964b5-539c-4b55-8f5c-dac0fcf13f27 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:25.849905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c7d62c7a-1ca5-4dd4-b3b7-a4efb01c4a0d tempest-VolumesNegativeTest-1608732781 tempest-VolumesNegativeTest-1608732781-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/677964b5-539c-4b55-8f5c-dac0fcf13f27" status: 404 len: 109 microversion: 2.1 time: 0.147244 Jul 28 17:44:25.850765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 8/9] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:25 2022] GET /compute/v2.1/os-volumes/677964b5-539c-4b55-8f5c-dac0fcf13f27 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:25.918058 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6c92bf8e-9ea5-4ffd-b47b-0ef62869f908 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 200 len: 345 microversion: 2.1 time: 0.132186 Jul 28 17:44:25.918630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 2/10] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:25 2022] GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:26.937649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-94cacf88-3d0f-42ee-94a4-14ad6c8f3deb tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c6164c0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:27.055658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-94cacf88-3d0f-42ee-94a4-14ad6c8f3deb tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 200 len: 346 microversion: 2.1 time: 0.126162 Jul 28 17:44:27.056260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 9/11] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:26 2022] GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:27.070835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5782bf03-dfab-4390-96bc-42eccdac9a5c tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Action: 'create', calling method: .version_select at 0x7fce3c6991f0>, body: {"snapshot": {"volume_id": "67572ff4-3ef1-438a-80f5-094a59aa4c02", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1868919219"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:27.498767 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5782bf03-dfab-4390-96bc-42eccdac9a5c tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.432321 Jul 28 17:44:27.500509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 3/12] 10.222.0.89 () {60 vars in 1162 bytes} [Thu Jul 28 17:44:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:27.515639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-52c3950f-eccc-4724-98b5-b4811131dbf6 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c616040>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:27.682089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-52c3950f-eccc-4724-98b5-b4811131dbf6 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.175383 Jul 28 17:44:27.682872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 10/13] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:27 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:27.694921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f0621d0d-048e-44ab-bf6d-298018d95f92 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69e3a0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:27.764786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f0621d0d-048e-44ab-bf6d-298018d95f92 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.073431 Jul 28 17:44:27.771828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 4/14] 10.222.0.89 () {58 vars in 1140 bytes} [Thu Jul 28 17:44:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:27.780383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d15066d-e662-4467-ad1d-876895be6b14 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c6200d0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:27.834872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1d15066d-e662-4467-ad1d-876895be6b14 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.061648 Jul 28 17:44:27.835451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 11/15] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:27 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:28.848795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a370f721-038c-45bc-8ca2-5fee9cd48e98 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c6991f0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:28.945813 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a370f721-038c-45bc-8ca2-5fee9cd48e98 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.102451 Jul 28 17:44:28.946486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 5/16] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:28 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:29.959211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-30900901-0fba-4933-ae39-d7cee1645696 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c620790>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:30.013555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-30900901-0fba-4933-ae39-d7cee1645696 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.058120 Jul 28 17:44:30.014126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 12/17] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:29 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:31.040485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1d2f0f15-a483-4a27-b862-1fd8c0d0c95d tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c688c10>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:31.081966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1d2f0f15-a483-4a27-b862-1fd8c0d0c95d tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.045159 Jul 28 17:44:31.083381 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 6/18] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:31 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:32.095439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ea62b045-bd97-4e06-8e86-ef85e6e0d383 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c616280>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:32.191157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ea62b045-bd97-4e06-8e86-ef85e6e0d383 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 288 microversion: 2.1 time: 0.099784 Jul 28 17:44:32.191774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 13/19] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:32 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:32.203634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7dfbb7f4-53bb-4c98-a812-314b4fd7db98 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69e160>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:32.396980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7dfbb7f4-53bb-4c98-a812-314b4fd7db98 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "DELETE /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 202 len: 0 microversion: 2.1 time: 0.197465 Jul 28 17:44:32.397580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 7/20] 10.222.0.89 () {58 vars in 1254 bytes} [Thu Jul 28 17:44:32 2022] DELETE /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:44:32.406736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-932b95d1-df99-4d48-b75b-b3a8f7d2c49a tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c616670>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:32.457417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-932b95d1-df99-4d48-b75b-b3a8f7d2c49a tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.055142 Jul 28 17:44:32.457997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 14/21] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:32 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:33.470932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b8daf57a-9a88-492c-9aa4-d64505ab1230 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c688ee0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:33.545120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b8daf57a-9a88-492c-9aa4-d64505ab1230 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.079011 Jul 28 17:44:33.545763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 8/22] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:33 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:34.559371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-33c239a7-ced8-44f7-82e9-07d3b830a6b1 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c620b80>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:34.630712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-33c239a7-ced8-44f7-82e9-07d3b830a6b1 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.075031 Jul 28 17:44:34.635834 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 15/23] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:34 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:35.645818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b5b78fb5-8e9e-4e53-ac56-ad2ef7ddd115 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c699550>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:35.702895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b5b78fb5-8e9e-4e53-ac56-ad2ef7ddd115 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 200 len: 287 microversion: 2.1 time: 0.062012 Jul 28 17:44:35.703554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 9/24] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:35 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:36.226008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1494846605", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:36.513366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] validate_networks() for [('6c5bc62a-37b3-4ec7-a921-dd776df143f3', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:44:36.715541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-be87178c-cafc-4d32-8702-7f469785759f tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c699ee0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:36.789329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-be87178c-cafc-4d32-8702-7f469785759f tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] HTTP exception thrown: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-be87178c-cafc-4d32-8702-7f469785759f tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Request method failure captured: Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b HTTP/1.1 Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sr20Pm_Be8LjYiNEsuZHZKIKSBS6kPDYRb0gNAo_5ifP4Gk6D7Wer7B0N_TkwakuWtTK9XBzUcFatLM_kV7W9xSfSaY7FXUosAD45gwRPDnW_xNBQHHCOGGImnuaquxB6veZngmB8dv24rdNumFQXZ4dx1E8ma3kwDHENYKQvmuxiA Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:44:36.793233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ae0586e81d7e477ea9ae3efa55c8a4da Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '98f18da7-a970-4b65-8a3c-5f99735c7b3b'} Jul 28 17:44:36.794286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. (HTTP 404) (Request-ID: req-4308ece6-be99-473d-84fd-19b66069c81e) Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.794919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:36.795737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 17:44:36.797045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-be87178c-cafc-4d32-8702-7f469785759f tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Returning 404 to user: Snapshot 98f18da7-a970-4b65-8a3c-5f99735c7b3b could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:36.800116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-be87178c-cafc-4d32-8702-7f469785759f tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b" status: 404 len: 111 microversion: 2.1 time: 0.083300 Jul 28 17:44:36.801721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 10/25] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:44:36 2022] GET /compute/v2.1/os-snapshots/98f18da7-a970-4b65-8a3c-5f99735c7b3b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:36.804723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-25684401-ed67-4009-b222-ed468531ed36 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69eaf0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:36.990479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-25684401-ed67-4009-b222-ed468531ed36 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 202 len: 0 microversion: 2.1 time: 0.189832 Jul 28 17:44:36.994205 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 11/26] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:44:36 2022] DELETE /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:44:37.005818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-93c57b28-8363-4c72-be02-21b56c54f7c1 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69e790>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:37.152095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-93c57b28-8363-4c72-be02-21b56c54f7c1 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 200 len: 345 microversion: 2.1 time: 0.152520 Jul 28 17:44:37.158954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 12/27] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:36 2022] GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:38.168421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43ab6124-5582-4992-8bca-e96b782ac589 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69e700>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:38.220562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-43ab6124-5582-4992-8bca-e96b782ac589 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] HTTP exception thrown: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43ab6124-5582-4992-8bca-e96b782ac589 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Request method failure captured: Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 HTTP/1.1 Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sr20Pm_Be8LjYiNEsuZHZKIKSBS6kPDYRb0gNAo_5ifP4Gk6D7Wer7B0N_TkwakuWtTK9XBzUcFatLM_kV7W9xSfSaY7FXUosAD45gwRPDnW_xNBQHHCOGGImnuaquxB6veZngmB8dv24rdNumFQXZ4dx1E8ma3kwDHENYKQvmuxiA Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:44:38.223160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ae0586e81d7e477ea9ae3efa55c8a4da Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '67572ff4-3ef1-438a-80f5-094a59aa4c02'} Jul 28 17:44:38.224453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. (HTTP 404) (Request-ID: req-a6d85f53-e9c3-4907-a845-dc394da230a9) Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.225090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:38.225991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 17:44:38.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.227753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.233951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43ab6124-5582-4992-8bca-e96b782ac589 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Returning 404 to user: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:38.235052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-43ab6124-5582-4992-8bca-e96b782ac589 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 404 len: 109 microversion: 2.1 time: 0.072486 Jul 28 17:44:38.244670 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 13/28] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:38 2022] GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:38.272487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4100d929-a016-4491-95f0-bfbb8b32fe07 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c619280>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:38.344921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-4100d929-a016-4491-95f0-bfbb8b32fe07 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] HTTP exception thrown: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4100d929-a016-4491-95f0-bfbb8b32fe07 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Request method failure captured: Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 HTTP/1.1 Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sr20Pm_Be8LjYiNEsuZHZKIKSBS6kPDYRb0gNAo_5ifP4Gk6D7Wer7B0N_TkwakuWtTK9XBzUcFatLM_kV7W9xSfSaY7FXUosAD45gwRPDnW_xNBQHHCOGGImnuaquxB6veZngmB8dv24rdNumFQXZ4dx1E8ma3kwDHENYKQvmuxiA Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:44:38.347658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ae0586e81d7e477ea9ae3efa55c8a4da Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '67572ff4-3ef1-438a-80f5-094a59aa4c02'} Jul 28 17:44:38.348694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. (HTTP 404) (Request-ID: req-40d9e355-858c-4ef3-9bb4-ad3cd18f2228) Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.349417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 17:44:38.350305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 17:44:38.351182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.352059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.354297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4100d929-a016-4491-95f0-bfbb8b32fe07 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Returning 404 to user: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:38.355365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4100d929-a016-4491-95f0-bfbb8b32fe07 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 404 len: 109 microversion: 2.1 time: 0.102103 Jul 28 17:44:38.356126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 14/29] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:44:38 2022] DELETE /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:38.365527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6be2a159-0011-4145-be4b-946478015273 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Calling method '.version_select at 0x7fce3c69e430>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:38.445603 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-6be2a159-0011-4145-be4b-946478015273 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] HTTP exception thrown: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6be2a159-0011-4145-be4b-946478015273 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Request method failure captured: Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 HTTP/1.1 Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sr20Pm_Be8LjYiNEsuZHZKIKSBS6kPDYRb0gNAo_5ifP4Gk6D7Wer7B0N_TkwakuWtTK9XBzUcFatLM_kV7W9xSfSaY7FXUosAD45gwRPDnW_xNBQHHCOGGImnuaquxB6veZngmB8dv24rdNumFQXZ4dx1E8ma3kwDHENYKQvmuxiA Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:44:38.448918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1740f22f19344b8a91769cc0881dad7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 1740f22f19344b8a91769cc0881dad7b Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1966730499 Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ae0586e81d7e477ea9ae3efa55c8a4da Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1966730499-project Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '67572ff4-3ef1-438a-80f5-094a59aa4c02'} Jul 28 17:44:38.450223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. (HTTP 404) (Request-ID: req-d306c38c-a814-42a6-a062-b7dbee9e9e13) Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.450846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:44:38.451971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 17:44:38.453405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6be2a159-0011-4145-be4b-946478015273 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] Returning 404 to user: Volume 67572ff4-3ef1-438a-80f5-094a59aa4c02 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6be2a159-0011-4145-be4b-946478015273 tempest-VolumesSnapshotsTestJSON-1966730499 tempest-VolumesSnapshotsTestJSON-1966730499-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02" status: 404 len: 109 microversion: 2.1 time: 0.089280 Jul 28 17:44:38.455411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 15/30] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:44:38 2022] GET /compute/v2.1/os-volumes/67572ff4-3ef1-438a-80f5-094a59aa4c02 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:44:40.408716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:44:40.409841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:44:40.411174 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:44:40.412022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:44:40.412736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:44:40.444583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:40.446474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:40.454525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:40.455283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:40.527235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:40.547441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for user 14327b8153ab4de782d4bcfef7681fc1 and project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:40.586737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:44:40.589818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:44:40.763302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f519462c-0684-4aa7-9f35-191cfeb75e5d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.774594 Jul 28 17:44:40.764110 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 16/31] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:44:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:44:40.781995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43cb1fcf-5157-4f6d-a661-734dec3d7328 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:40.783954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-43cb1fcf-5157-4f6d-a661-734dec3d7328 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:41.165061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-43cb1fcf-5157-4f6d-a661-734dec3d7328 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:41.200830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-43cb1fcf-5157-4f6d-a661-734dec3d7328 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1222 microversion: 2.1 time: 0.427693 Jul 28 17:44:41.206496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 16/32] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:40 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1222 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:41.920737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2054484210", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:42.068695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] validate_networks() for [('6c5bc62a-37b3-4ec7-a921-dd776df143f3', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:44:43.428023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8ef6377d-c17a-428b-8445-053c0adaf163 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: .version_select at 0x7fce3c619160>, body: {"keypair": {"name": "tempest-keypair-968461231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6g1CipyD9QG/4VeJsmJmYQg10Bs3csisHGYGJgwUo5K8rP1SxXWnBlMLffJJYOkFHh94byEA/uKA1aHf5XtW5At5/+GY9SGXJ/LQKrhiLyRSjSXV1RQb0uldFkZjZbpQ=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:43.556576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:44:43.557086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:44:43.557495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:44:43.558173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:44:43.558599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:44:43.590994 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-8ef6377d-c17a-428b-8445-053c0adaf163 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:43.594978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:43.597413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:43.602030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:43.603363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:43.610148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-8ef6377d-c17a-428b-8445-053c0adaf163 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for user 22479a66b0f34038b144f4def1aa3f43 and project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:43.668842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:43.683341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for user 14327b8153ab4de782d4bcfef7681fc1 and project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:43.722201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:44:43.730370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8ef6377d-c17a-428b-8445-053c0adaf163 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.568909 Jul 28 17:44:43.730579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:44:43.752232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 17/33] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:44:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:43.857627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e189d58a-644d-4a84-8254-d06f87a8f6cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.948747 Jul 28 17:44:43.874656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 17/34] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:44:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:44:43.896497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bdc7ff59-b71f-42da-aaeb-5f4de66ea3c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:43.907707 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bdc7ff59-b71f-42da-aaeb-5f4de66ea3c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:44.373477 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bdc7ff59-b71f-42da-aaeb-5f4de66ea3c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:44.407053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bdc7ff59-b71f-42da-aaeb-5f4de66ea3c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1222 microversion: 2.1 time: 0.529383 Jul 28 17:44:44.422925 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 18/35] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:43 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1222 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:45.009989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-33447d94-82c4-4788-9ff8-697a22d57002 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: .version_select at 0x7fce3c5dd700>, body: {"keypair": {"name": "tempest-keypair-1455222813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGFhjgBghHRMoYHIcDXw3REGHuyg5sWLLabXTIst8fonEuzC5tbFcUkK36077K9KSR0KEAvPwlSLbV3GPfjqkjpfEG/VIkfmj7VUzfQkh9+vQnloym+vZBV4XFyRCAojw=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:45.080167 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-33447d94-82c4-4788-9ff8-697a22d57002 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for project 65535f9817c448dfac997e93efa1a909. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:45.097132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-33447d94-82c4-4788-9ff8-697a22d57002 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for user 0b97c60c0360466fb878e1e9141e1f3e and project 65535f9817c448dfac997e93efa1a909. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:45.226148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-33447d94-82c4-4788-9ff8-697a22d57002 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.470941 Jul 28 17:44:45.227371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 18/36] 10.222.0.89 () {62 vars in 1200 bytes} [Thu Jul 28 17:44:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1474 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 17:44:45.436262 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8d99dd9b-49f9-463c-9702-b5a99db4181b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:45.438238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8d99dd9b-49f9-463c-9702-b5a99db4181b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:45.649148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8d99dd9b-49f9-463c-9702-b5a99db4181b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:45.670334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8d99dd9b-49f9-463c-9702-b5a99db4181b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1222 microversion: 2.1 time: 0.243131 Jul 28 17:44:45.678594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 19/37] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:45 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:46.700244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:46.701609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:46.721358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:46.728309 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:46.730227 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:46.733029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:47.318458 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1159445827", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "networks": [{"uuid": "cbd36208-112c-4d11-9738-c86cba94c43a"}]}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:47.464032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:47.497098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e68582e6-2f23-4ffb-941c-01a9b029777d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1274 microversion: 2.1 time: 0.797261 Jul 28 17:44:47.509232 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 20/38] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:46 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1274 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:47.569187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] validate_networks() for [('cbd36208-112c-4d11-9738-c86cba94c43a', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:44:48.525379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:48.526655 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:48.553010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:48.555686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:48.559353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:48.559992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:48.846012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:48.855228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-38a2227a-4d29-4bdd-b6b2-aa45525c5862 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1280 microversion: 2.1 time: 0.334621 Jul 28 17:44:48.858755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 21/39] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:48 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:49.889723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:49.892840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:49.933211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:49.947746 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:49.952335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:49.953007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:50.932921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:50.959594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dbbd78e9-9b23-444f-8bcc-e3291405b5b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1280 microversion: 2.1 time: 1.084447 Jul 28 17:44:50.961134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 22/40] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:49 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1280 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:51.492313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-621836624", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae8fa151-853f-466c-9398-a2ea0d9328cd"}], "security_groups": [{"name": "tempest-securitygroup--1523326052"}], "key_name": "tempest-keypair-968461231", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:52.081946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] validate_networks() for [('ae8fa151-853f-466c-9398-a2ea0d9328cd', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:44:52.603160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:44:52.604640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:44:52.604640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:44:52.605379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:44:52.605497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:44:52.631157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:52.631752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:52.635664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:52.638102 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:52.728418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Getting quotas for project 6018db8e046e4945be4dd56ff8e8eeea. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:52.745241 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Getting quotas for user 6ed334d56f34486ebd8b52247d060856 and project 6018db8e046e4945be4dd56ff8e8eeea. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:52.787987 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:44:52.798116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:44:53.127035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ea9154d9-30e8-459c-ba11-8af9353ae232 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.112139 Jul 28 17:44:53.128928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 19/41] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:44:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 7115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:44:53.143096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:53.147343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:53.185147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:53.185147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:53.185147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:53.185147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:53.640810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=4 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:55.024942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:44:55.026139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:44:55.026870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:44:55.027418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:44:55.028083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:44:55.046074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:55.048830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:55.050281 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:55.050977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:55.094896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:55.106597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for user 22479a66b0f34038b144f4def1aa3f43 and project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:55.137088 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:44:55.141125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:44:55.270791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5a754b6d-f452-49f1-89fc-b3409b2c016d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.783457 Jul 28 17:44:55.279615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 23/42] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:44:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 17:44:55.287371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:55.288148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:55.300748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:55.303656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:55.316935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:55.318936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:55.590679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:55.606059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-806cf5fe-9cb4-4232-ad8f-8969590c0cd0 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1211 microversion: 2.1 time: 0.324087 Jul 28 17:44:55.607423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 24/43] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:55 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1211 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:55.641480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6e87661d-33ee-4808-b492-a6c73b5b5d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:55.643395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6e87661d-33ee-4808-b492-a6c73b5b5d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:55.730162 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:55.795046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a1b13d62-3220-40e7-a88a-697e5fbb5878 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 2.664505 Jul 28 17:44:55.814984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 20/44] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:53 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:55.937984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6e87661d-33ee-4808-b492-a6c73b5b5d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:55.953882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6e87661d-33ee-4808-b492-a6c73b5b5d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1236 microversion: 2.1 time: 0.316525 Jul 28 17:44:55.973380 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 25/45] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:55 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1236 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:56.630468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:56.630468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:56.657235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:56.657699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:56.658745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:56.659336 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:56.823077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:56.824388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:56.864161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:56.865519 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:56.867332 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:56.871992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:57.362567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:57.376170 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4f16e070-9af6-4de7-a2b7-49890da69394 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1285 microversion: 2.1 time: 0.751968 Jul 28 17:44:57.376776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 21/46] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:56 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1285 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:57.382172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:57.382804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:57.433491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:57.441415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:57.442402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:57.442860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:57.903511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:57.923529 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-967b6386-04cb-4d58-bfc8-63022e62094d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1232 microversion: 2.1 time: 0.545157 Jul 28 17:44:57.943375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 22/47] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:57 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1232 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:57.986282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:57.995422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d29ab8f9-1bfb-4fda-a7f8-61144370347d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 1.178420 Jul 28 17:44:58.000630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 26/48] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:56 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:44:58.221103 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2043355367", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f60734d5-8026-4cb9-8d4b-31a05ecd50e4"}], "security_groups": [{"name": "tempest-securitygroup--1390648065"}], "key_name": "tempest-keypair-1455222813", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:58.334249 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-9d25c4bb-c430-48a2-9a9d-d5b5eb042278 req-cdebfbba-b9d5-4330-a40c-719cc1e01628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00daefb-7ad3-4334-8db5-47043d2c2c09", "tag": "fce94af7-010d-4f2b-9d29-fdfc9ec97409"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:44:58.377816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-9d25c4bb-c430-48a2-9a9d-d5b5eb042278 req-cdebfbba-b9d5-4330-a40c-719cc1e01628 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.378449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-9d25c4bb-c430-48a2-9a9d-d5b5eb042278 req-cdebfbba-b9d5-4330-a40c-719cc1e01628 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.432976 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-9d25c4bb-c430-48a2-9a9d-d5b5eb042278 req-cdebfbba-b9d5-4330-a40c-719cc1e01628 service nova] Creating event network-changed:fce94af7-010d-4f2b-9d29-fdfc9ec97409 for instance c00daefb-7ad3-4334-8db5-47043d2c2c09 on hv-cinder-81322 Jul 28 17:44:58.435379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-9d25c4bb-c430-48a2-9a9d-d5b5eb042278 req-cdebfbba-b9d5-4330-a40c-719cc1e01628 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 17:44:58.437145 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.437611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.438421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.443873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.470760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.compute.rpcapi [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 17:44:58.472664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=124515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 17:44:58.515726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9d32c6f4-c701-4f65-8aba-e88e516e13e0 None None] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501459 Jul 28 17:44:58.516686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 23/49] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:44:58.524996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:58.527371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:58.562763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.564032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.565104 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.566018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.619133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] validate_networks() for [('f60734d5-8026-4cb9-8d4b-31a05ecd50e4', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:44:58.772248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:58.802187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c345364e-d4e1-4b63-a228-0eeea67add9c tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1273 microversion: 2.1 time: 0.284032 Jul 28 17:44:58.822724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 24/50] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:58 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:58.949266 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:58.949881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:58.961589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.962724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:58.965801 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:58.966268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.091841 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:59.111457 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7f2879bb-cb2e-4f77-89c3-6773d9844793 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1232 microversion: 2.1 time: 0.163048 Jul 28 17:44:59.113264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 25/51] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:58 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1232 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:59.131982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:59.134040 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:59.149232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.150728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.151871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.152501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.409557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:44:59.422919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9d9bdc7a-91f3-4593-8982-2f8f0e177600 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.304871 Jul 28 17:44:59.436489 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 26/52] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:59 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:44:59.619469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:44:59.619927 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:44:59.620544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:44:59.620900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:44:59.621607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:44:59.656225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.657394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.662887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.666609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.726478 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for project 65535f9817c448dfac997e93efa1a909. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:44:59.739751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for user 0b97c60c0360466fb878e1e9141e1f3e and project 65535f9817c448dfac997e93efa1a909. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:44:59.779748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:44:59.785014 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:44:59.830432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:44:59.831583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:44:59.851893 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.855996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.895282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:44:59.896154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:44:59.983491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-01ac13ab-4508-4677-9250-54fb21d641f9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.766640 Jul 28 17:44:59.986876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 27/53] 10.222.0.89 () {62 vars in 1188 bytes} [Thu Jul 28 17:44:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 17:45:00.000003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:00.002156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:00.243858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:00.256266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:00.258907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:00.262449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e3885f8f-8a98-4efc-99fa-1cabdd643801 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1282 microversion: 2.20 time: 0.267990 Jul 28 17:45:00.267194 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 28/54] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:44:59 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:00.280439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:00.284904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:00.308766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:00.309457 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:00.310275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:00.326132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:00.513875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:00.525635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-21eb4a3a-882f-4dd9-9794-5a17e35ae26d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1232 microversion: 2.1 time: 0.257025 Jul 28 17:45:00.534401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 29/55] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:00 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1232 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:00.547166 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:00.551517 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:00.576378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:00.578681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:00.587245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:00.594995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:00.953012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:00.992153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-888f224c-6b52-44e8-95a3-7e47b4fbea71 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 1.162331 Jul 28 17:45:01.010583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 27/56] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:44:59 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:01.054524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-0b4b3a9a-2bef-4e60-a74f-83d791a75371 req-c461a343-2570-4d40-ae47-0be94b8cd85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0a7816-0379-49a1-acae-959a72fa36b8", "tag": "320b8217-84b0-4579-b2de-291315cf5fe9"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:01.110783 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0b4b3a9a-2bef-4e60-a74f-83d791a75371 req-c461a343-2570-4d40-ae47-0be94b8cd85f service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:01.114442 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0b4b3a9a-2bef-4e60-a74f-83d791a75371 req-c461a343-2570-4d40-ae47-0be94b8cd85f service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:01.166545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-0b4b3a9a-2bef-4e60-a74f-83d791a75371 req-c461a343-2570-4d40-ae47-0be94b8cd85f service nova] Creating event network-changed:320b8217-84b0-4579-b2de-291315cf5fe9 for instance 0a0a7816-0379-49a1-acae-959a72fa36b8 on hv-cinder-81322 Jul 28 17:45:01.192385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-0b4b3a9a-2bef-4e60-a74f-83d791a75371 req-c461a343-2570-4d40-ae47-0be94b8cd85f service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177127 Jul 28 17:45:01.197514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 28/57] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:01.299951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:01.305535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:01.706125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:01.742755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:01.744804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:01.747326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8c46087f-d4b1-48ae-abc6-8951595ecb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1282 microversion: 2.20 time: 0.454998 Jul 28 17:45:01.748684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 29/58] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:01 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1282 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:01.754580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:01.755826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:01.765620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:01.766725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:01.768204 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:01.768873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:02.340668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:02.354877 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9188ea55-a6a1-445b-8f63-012720b86c80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1306 microversion: 2.1 time: 0.603306 Jul 28 17:45:02.356190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 30/59] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:01 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1306 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:02.373374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:02.374300 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:02.391330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:02.396471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:02.397566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:02.398221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:02.737233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:02.763010 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c563ec47-eedf-4d67-bad3-da5dbb26db30 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.400356 Jul 28 17:45:02.768075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 31/60] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:02 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:02.768875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:02.775343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:02.782397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-54be2ba3-ac27-4d27-ae3e-0d5ebb368919 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 2.246539 Jul 28 17:45:02.783689 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:02.789149 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 30/61] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:00 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:02.801820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:02.804988 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:02.807765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:02.808426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.390873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:03.391519 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:03.406200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:03.416782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.419144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.420393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.423010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.700100 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:03.719599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:03.723522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:03.735653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-518c90bb-4152-4282-8ff9-29031a0b2190 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1334 microversion: 2.20 time: 0.964091 Jul 28 17:45:03.741232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 32/62] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:02 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1334 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:03.784402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:03.785376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:03.789760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=5 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:03.807649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.824065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.827006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.830764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.849864 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:03.868874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e89da981-5d89-4764-9648-79727a4d528b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1294 microversion: 2.1 time: 0.479864 Jul 28 17:45:03.894432 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 31/63] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:03 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1294 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:03.933189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:03.937518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:03.958531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.959444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:03.960454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:03.963810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:04.505601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:04.515615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bb7831d1-d9ed-4561-bb56-5b8078d29c97 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.735703 Jul 28 17:45:04.516800 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 33/64] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:03 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:04.764573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:04.766814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:04.777373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:04.777814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:04.778608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:04.779282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:04.806701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:04.810287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=61 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:04.819916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-77e11a9c-638a-4497-9559-14caf8e3ed89 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.922806 Jul 28 17:45:04.821661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 32/65] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:03 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:04.893548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:04.904454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:04.908321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:04.908321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e8934fbd-e342-4d36-b3c1-1a1768b01d07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1340 microversion: 2.20 time: 0.147202 Jul 28 17:45:04.908321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 34/66] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:04 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1340 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:04.912974 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:04.913612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:04.919834 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:04.920284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:04.921720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:04.922178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.002058 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:05.011827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d948a265-1be0-4047-b593-8f9ce57656e0 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1294 microversion: 2.1 time: 0.102608 Jul 28 17:45:05.025200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 35/67] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:04 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:05.057534 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-642d3557-1648-4117-8df3-1c8a0bf3e1b9 req-2430c735-3d47-4919-809e-1c5cee76d26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df8eb85-99c9-46db-8ffc-313f53d8a559", "tag": "59e7f4e7-e3a7-4a27-b67d-dea37480a3a0"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:05.072694 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-642d3557-1648-4117-8df3-1c8a0bf3e1b9 req-2430c735-3d47-4919-809e-1c5cee76d26a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.073142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-642d3557-1648-4117-8df3-1c8a0bf3e1b9 req-2430c735-3d47-4919-809e-1c5cee76d26a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.096077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-642d3557-1648-4117-8df3-1c8a0bf3e1b9 req-2430c735-3d47-4919-809e-1c5cee76d26a service nova] Creating event network-changed:59e7f4e7-e3a7-4a27-b67d-dea37480a3a0 for instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 on hv-cinder-81322 Jul 28 17:45:05.096740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-642d3557-1648-4117-8df3-1c8a0bf3e1b9 req-2430c735-3d47-4919-809e-1c5cee76d26a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 17:45:05.098171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.098607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.099381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.099809 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.111081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.compute.rpcapi [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 17:45:05.111828 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] Releasing lock "compute-rpcapi-router" {{(pid=124516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 17:45:05.136341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4debddd3-4ca1-4b4c-961e-9c87fb0f9294 None None] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256350 Jul 28 17:45:05.137652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 33/68] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:45:05.537622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:05.538578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:05.545489 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.547153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.548256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.548898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.715155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:05.724063 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0ade7d84-8dc2-4f18-8bf4-759f2e718cce tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.190208 Jul 28 17:45:05.724660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 36/69] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:05 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:05.844645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:05.845676 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:05.852981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.853548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.854656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.855164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.935687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:05.937550 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:05.945068 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.946053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:05.947032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:05.947787 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:06.026064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:06.035477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:06.037144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:06.038288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ffb695b5-35c0-4935-8ade-25fcb23eb742 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1340 microversion: 2.20 time: 0.106745 Jul 28 17:45:06.039162 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 37/70] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:05 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:06.043778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:06.044379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:06.051178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:06.051964 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:06.052732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:06.053183 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:06.057672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:06.086630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:06.098018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7261590d-c34c-4ad3-bcbc-dba67af25a12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.258799 Jul 28 17:45:06.114581 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 34/71] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:05 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:06.214161 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:06.225608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f57bd6d7-bb05-4673-a4de-9979697c7d8c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.184712 Jul 28 17:45:06.238122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 38/72] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:06 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:06.748627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:06.750682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:06.757802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:06.758265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:06.759131 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:06.759877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.023448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.031810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2a785644-85c9-4e69-b9da-5d9a421cdf60 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.288472 Jul 28 17:45:07.033660 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 35/73] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:06 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:07.063620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:07.064676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:07.071302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.071943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.072991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.073516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.120936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:07.121675 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:07.129219 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.129947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.131009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.131671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.161034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.175527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.177358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.178648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9b54eddb-1d9e-4fc2-aeae-f735f4278ed8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1340 microversion: 2.20 time: 0.120064 Jul 28 17:45:07.205225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 39/74] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:07 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1340 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:07.251487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:07.252094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:07.258372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.259067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.260282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:07.261031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:07.520045 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.536670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-af2f981d-e5f3-4794-b238-bd4b098ee9c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.418804 Jul 28 17:45:07.539681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 36/75] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:07 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:07.604991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:07.623178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-801860b8-4c5b-4d14-a75c-f1f9a18f0edb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.376510 Jul 28 17:45:07.625207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 40/76] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:07 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:08.055123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:08.055698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:08.063083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.063766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.064715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.066366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.208879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:08.209643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:08.217291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.218476 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.219857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.220726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.299908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:08.309441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:08.312081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:08.313941 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-94eb6af8-c614-42da-b74d-d0fc8bfa2086 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1340 microversion: 2.20 time: 0.108727 Jul 28 17:45:08.315608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 41/77] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:08 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:08.417500 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:08.430257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-32db8aa4-0eb8-468a-bbfd-0473adfafe05 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.377754 Jul 28 17:45:08.432326 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 37/78] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:08 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:08.560699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:08.561334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:08.568239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=4 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:08.570215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.570928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.571923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.572615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.648016 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:08.648854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:08.658627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.659072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.659845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:08.660280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:08.872644 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:08.880346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8dbbc2c1-c6f2-4ebd-96d7-6ce97d1f1934 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.323394 Jul 28 17:45:08.885188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 42/79] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:08 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:09.229354 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:09.237299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-999f5583-8886-4cfd-aef7-a19f18942271 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.594257 Jul 28 17:45:09.241291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 38/80] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:08 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:09.340704 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:09.341855 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:09.351928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.352359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:09.353135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.353588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:09.435041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:09.447690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:09.451660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:09.454943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7edbb171-dc6d-4cad-b8eb-b789fab9804a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1340 microversion: 2.20 time: 0.119796 Jul 28 17:45:09.456484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 43/81] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:09 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:09.457576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:09.458721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:09.466555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.467111 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:09.468546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.469140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:09.888728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:09.902842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:09.907910 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:09.911572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e5bacd5b-1926-4037-86f4-1c572ccd2d12 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.461251 Jul 28 17:45:09.912651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 39/82] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:09 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:09.932216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.932722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:09.933629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:09.934078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.114010 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:10.131368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a84f5a2e-03c9-43a5-9eba-ac93f25203ee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.232310 Jul 28 17:45:10.141998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 44/83] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:09 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:10.149566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-c4fd88ed-d64e-42aa-a5b7-121d416895cf req-d011671e-1037-4101-80b1-8d0b557fddd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f84a7a8-29b0-4dfb-a6dd-11e25f978217", "tag": "68d3356b-d07b-40b6-8d0a-f9dfbab82c03"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:10.165218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c4fd88ed-d64e-42aa-a5b7-121d416895cf req-d011671e-1037-4101-80b1-8d0b557fddd8 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.170749 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c4fd88ed-d64e-42aa-a5b7-121d416895cf req-d011671e-1037-4101-80b1-8d0b557fddd8 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.199146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-c4fd88ed-d64e-42aa-a5b7-121d416895cf req-d011671e-1037-4101-80b1-8d0b557fddd8 service nova] Creating event network-changed:68d3356b-d07b-40b6-8d0a-f9dfbab82c03 for instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 on hv-cinder-81322 Jul 28 17:45:10.207000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-c4fd88ed-d64e-42aa-a5b7-121d416895cf req-d011671e-1037-4101-80b1-8d0b557fddd8 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062728 Jul 28 17:45:10.209786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 40/84] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:10.258744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:10.259664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:10.270716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.271181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.275158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.275894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.481688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:10.482449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:10.484924 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:10.491721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=32 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.494430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.494865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3de8ecf0-48a0-4f63-9f29-bc9dff821246 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.238845 Jul 28 17:45:10.495245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.504122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 45/85] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:10 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:10.510138 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.510867 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.936290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:10.937619 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:10.945415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.946085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:10.947044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:10.947696 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:11.377881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.386984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b5a48bbb-5336-4461-bb85-20fca79f36d1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.455701 Jul 28 17:45:11.387676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 46/86] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:10 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:11.402047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:11.403238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:11.413051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:11.413959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:11.414978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:11.415620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:11.487537 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.499973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.502445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.503829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b6897b4c-3b5e-4512-b003-8d24e56fd2ac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 1.025588 Jul 28 17:45:11.504510 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 41/87] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:10 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:11.526335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:11.527152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:11.534493 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:11.535001 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:11.535836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:11.536264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:11.715514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.719278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=18 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.727552 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cf907d39-5ea1-4d0a-ae0d-fc34164d2f59 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.338547 Jul 28 17:45:11.728361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 47/88] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:11 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:11.790038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:11.800522 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5eb2a4f6-f8d4-4175-8210-db7379a4c4c2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.279754 Jul 28 17:45:11.801144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 42/89] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:11 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:12.413424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:12.414431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:12.424506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.430267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:12.431278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.431893 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:12.532042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:12.533040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:12.551930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.563331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:12.564898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.565461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:12.835572 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:12.847712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9adf9e03-1948-4e6c-8092-c283aa79254e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.435566 Jul 28 17:45:12.849728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 48/90] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:12 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:12.860096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:12.862838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:12.880682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.881418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:12.882720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:12.883454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:13.269225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:13.282307 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:13.289339 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:13.290755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c7e9808d-72f7-4932-b04e-859e573825c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.764267 Jul 28 17:45:13.293473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 43/91] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:12 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:13.304580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:13.307008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:13.321047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:13.324054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:13.326624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:13.328142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:13.495729 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:13.530033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2391dacf-3929-4b60-918d-884ddf73c0c8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.678925 Jul 28 17:45:13.536190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 49/92] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:12 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:13.572208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-dcba3914-684f-4f9c-99d3-116346950543 req-19ff116e-0c60-4069-b13c-da665edc756e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:13.619604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-dcba3914-684f-4f9c-99d3-116346950543 req-19ff116e-0c60-4069-b13c-da665edc756e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:13.619604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-dcba3914-684f-4f9c-99d3-116346950543 req-19ff116e-0c60-4069-b13c-da665edc756e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:13.662873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-dcba3914-684f-4f9c-99d3-116346950543 req-19ff116e-0c60-4069-b13c-da665edc756e service nova] Creating event network-changed:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:45:13.683538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-dcba3914-684f-4f9c-99d3-116346950543 req-19ff116e-0c60-4069-b13c-da665edc756e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126208 Jul 28 17:45:13.691725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 50/93] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:13.851266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:13.864164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6e374216-759f-496a-b5da-9a49e9a1d148 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.566067 Jul 28 17:45:13.867474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 44/94] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:13 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:13.884113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:13.885824 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:13.896926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:13.897817 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:13.898848 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:13.899898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.150377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:14.162280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ba1ae339-529d-4b3a-a36f-b736be332f7e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.295182 Jul 28 17:45:14.163426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 51/95] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:13 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:14.323021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:14.323648 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:14.337992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.338445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.339230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.339663 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.561377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:14.562225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:14.584921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.585587 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.586566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.587150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.678892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:14.689778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:14.692484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:14.693971 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7194ebaa-745e-4266-8532-748026c8b92a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.377886 Jul 28 17:45:14.694685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 45/96] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:14 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:14.863233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:14.871980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-793af788-eda7-40b6-952b-06b5e02b88f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.315710 Jul 28 17:45:14.873254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 52/97] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:14 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:14.889013 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:14.890410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:14.899873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.900683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:14.901818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:14.902435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.107523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.116000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:15.125934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-84dd0565-4652-41d0-af92-e460962600d8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.242584 Jul 28 17:45:15.126708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 46/98] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:14 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:15.185718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:15.187374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:15.195314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.195765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.198286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.198591 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.404380 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:15.417565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d7904501-7078-48f6-8c37-e19d28f31823 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.235793 Jul 28 17:45:15.421847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 53/99] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:15 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:15.727763 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:15.729905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:15.744764 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.745180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.745980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.746416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.901343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:15.902182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:15.911989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.912674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.913655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:15.914247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:15.935564 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:15.948246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:15.953090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:15.956442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7cd0e64a-4b51-447b-adf3-d8a5eda65717 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.233914 Jul 28 17:45:15.957898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 47/100] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:15 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:16.107827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:16.118694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5a42e85b-34cb-4601-88a6-fd4094b8ed24 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.222447 Jul 28 17:45:16.133922 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 54/101] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:15 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:16.149571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:16.150273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:16.165962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.165962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:16.165962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.165962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:16.389064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:16.398089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2f78ac06-a4c9-40ba-bf87-320ce927169f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.252284 Jul 28 17:45:16.399059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 48/102] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:16 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:16.441989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:16.442722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:16.448718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.449194 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:16.449995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.450563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:16.475343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.607624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:16.615796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-71850e71-dade-4291-954e-ff6dd1618590 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.179823 Jul 28 17:45:16.616572 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 55/103] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:16 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:16.984976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:16.985623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:16.991766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.992220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:16.992991 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:16.993455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.144132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:17.144593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:17.150765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.151220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.151983 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.152419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.178726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.189609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.191116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.192254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cbcd9424-67e6-4e67-936d-fe0684471e65 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.212137 Jul 28 17:45:17.193417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 49/104] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:16 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:17.303389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.313930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-836a9d75-83a7-4e57-8957-b567cb21e4d0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.173929 Jul 28 17:45:17.314504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 56/105] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:17 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:17.419656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:17.420265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:17.427242 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.427692 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.428490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.428923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.444050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:17.564845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.572597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a6f37c3c-a1e8-4d7c-9981-b0a5a09c04d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.156765 Jul 28 17:45:17.573225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 50/106] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:17 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:17.637887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:17.638570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:17.645062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.645542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.646312 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:17.646750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:17.782184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:17.797232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-83cd50ee-4ccf-4373-b74d-c57e3dc6df16 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.163146 Jul 28 17:45:17.797999 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 57/107] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:17 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:18.216054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:18.216772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:18.223735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.224182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.224936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.225402 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.336087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:18.336949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:18.343355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.343805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.344588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.345013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.371071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:18.381657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:18.383597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:18.385118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-07c75859-c593-4289-8761-d04446876e19 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.172994 Jul 28 17:45:18.385837 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 51/108] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:18 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:18.481959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:18.490431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aaf1cd0b-24ba-45d8-92bf-82611d383615 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.158429 Jul 28 17:45:18.491009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 58/109] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:18 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:18.594205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:18.595018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:18.600944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.601423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.602178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.602603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.818970 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:18.819579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:18.823316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:18.825954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.826405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.828271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:18.829029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:18.839927 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-880535bc-d810-4155-a833-f5df6d868d37 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.249505 Jul 28 17:45:18.840563 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 52/110] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:18 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:19.020389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:19.029461 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5491ef5f-91f4-49ce-9c42-ebdc5c8b871e tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.214283 Jul 28 17:45:19.043428 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 59/111] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:18 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:19.410777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:19.412310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:19.418993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.419695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:19.420482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.432872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:19.512098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:19.513486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:19.520295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.521092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:19.522186 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.523348 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:19.596525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:19.606618 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:19.609772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:19.611741 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-133666a3-0c6f-4033-bfad-4f999ce02e7e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.206854 Jul 28 17:45:19.612602 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 53/112] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:19 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:19.709099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:19.721350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-34f1e7e4-9ebf-4b17-9bc4-b78ce068db15 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.212172 Jul 28 17:45:19.721938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 60/113] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:19 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:19.868547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:19.869467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:19.886004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.890646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:19.891748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:19.895029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.075907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-a804146f-d3f9-4356-b0e2-9a8fbc283ebb req-6b5a4369-c515-437d-bd27-abaa7a723625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00daefb-7ad3-4334-8db5-47043d2c2c09", "name": "network-vif-plugged", "status": "completed", "tag": "fce94af7-010d-4f2b-9d29-fdfc9ec97409"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:20.096628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a804146f-d3f9-4356-b0e2-9a8fbc283ebb req-6b5a4369-c515-437d-bd27-abaa7a723625 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.097070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a804146f-d3f9-4356-b0e2-9a8fbc283ebb req-6b5a4369-c515-437d-bd27-abaa7a723625 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.126481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.138436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-480183f2-4501-4855-9624-34c1734d8ac9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.276661 Jul 28 17:45:20.153332 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 54/114] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:19 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:20.163068 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-a804146f-d3f9-4356-b0e2-9a8fbc283ebb req-6b5a4369-c515-437d-bd27-abaa7a723625 service nova] Creating event network-vif-plugged:fce94af7-010d-4f2b-9d29-fdfc9ec97409 for instance c00daefb-7ad3-4334-8db5-47043d2c2c09 on hv-cinder-81322 Jul 28 17:45:20.164959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:20.168729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:20.177938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-a804146f-d3f9-4356-b0e2-9a8fbc283ebb req-6b5a4369-c515-437d-bd27-abaa7a723625 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215165 Jul 28 17:45:20.179583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 61/115] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:45:20.182468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.183087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.184151 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.184737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.369881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.382029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9e534ec3-ef6b-4b86-80ca-165ab6fafa62 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.226544 Jul 28 17:45:20.382866 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 55/116] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:20 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:20.636290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:20.637446 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:20.645520 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.646169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.646862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.647699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.744481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:20.745924 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:20.761512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.761961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.762746 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:20.763171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:20.808580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.817810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.819067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.820655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-68c168f4-5df1-4894-b904-837b517b69a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.189416 Jul 28 17:45:20.821244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 62/117] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:20 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:20.934785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:20.944949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-82979100-0049-46ff-ba2f-a29cc2f61f65 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.206380 Jul 28 17:45:20.945962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 56/118] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:20 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:21.163619 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:21.164935 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:21.172738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.173400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.174720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.175298 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.332846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:21.342326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-500d92e3-8d8a-4075-afde-f14a2e959de4 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.182895 Jul 28 17:45:21.343487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 63/119] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:21 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:21.403715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:21.404541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:21.411443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.411933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.412705 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.413252 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.552850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:21.561737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ea58f0cc-701d-4adc-a2e9-ef92a5867153 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.160412 Jul 28 17:45:21.562932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 57/120] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:21 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:21.843806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:21.844812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:21.851251 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.851704 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.852483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.852955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.966980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:21.967601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:21.973842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.974299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.975182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:21.975498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:21.992474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.001651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.003612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.005442 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e3208f8c-2d63-4e01-b21d-f89110e65fe5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.165410 Jul 28 17:45:22.024807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 64/121] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:21 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:22.126115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.136555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a6ca4d28-4dee-4827-9c3e-eb5ac1d8a57c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.173283 Jul 28 17:45:22.137144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 58/122] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:21 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:22.218601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df8eb85-99c9-46db-8ffc-313f53d8a559", "name": "network-vif-plugged", "status": "completed", "tag": "59e7f4e7-e3a7-4a27-b67d-dea37480a3a0"}, {"server_uuid": "0a0a7816-0379-49a1-acae-959a72fa36b8", "name": "network-vif-plugged", "status": "completed", "tag": "320b8217-84b0-4579-b2de-291315cf5fe9"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:22.238625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:22.239069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:22.254032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] Creating event network-vif-plugged:59e7f4e7-e3a7-4a27-b67d-dea37480a3a0 for instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 on hv-cinder-81322 Jul 28 17:45:22.254577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] Creating event network-vif-plugged:320b8217-84b0-4579-b2de-291315cf5fe9 for instance 0a0a7816-0379-49a1-acae-959a72fa36b8 on hv-cinder-81322 Jul 28 17:45:22.261817 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-915173d8-e0d7-418c-9c22-aa595ffc61c6 req-edb7d5a7-ba31-4c0c-8584-f87c6aa7202d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047079 Jul 28 17:45:22.262586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 65/123] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:22.364415 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:22.365027 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:22.393639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:22.395876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:22.400464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:22.402618 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:22.585609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:22.586567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:22.602718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:22.603138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:22.604008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:22.610580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:22.774284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.798479 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-50e624ef-96e4-45da-9c0f-7f16959d88e8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.437766 Jul 28 17:45:22.799430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 59/124] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:22 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:22.837702 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:22.846501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e8511dcc-99e7-4d7f-afe4-4f02057bc39d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.266402 Jul 28 17:45:22.847075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 66/125] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:22 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:23.029443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:23.030048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:23.036204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.036656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.037453 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.037994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.157978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:23.158586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:23.164990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.165698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.166462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.167050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.326949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:23.336248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a36cf673-316f-4bf8-93b9-511bac109c27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.182546 Jul 28 17:45:23.337065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 67/126] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:23 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:23.445431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:23.456010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:23.459423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:23.461122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d3c58f43-1428-4ad6-b62c-7ddf9409d630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.434990 Jul 28 17:45:23.461260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 60/127] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:23 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:23.819938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:23.820584 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:23.831006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.831006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.831006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.831006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.867683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:23.868299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:23.878038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.878491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:23.879274 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:23.880310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:24.042359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.051598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f93b8903-fc7d-4119-948c-7ac30cef2e74 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.235697 Jul 28 17:45:24.053503 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 68/128] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:23 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:24.104067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.113008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-66539675-fe7d-43a8-bcd3-b7bcbf6d1503 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.248990 Jul 28 17:45:24.121301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 61/129] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:23 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:24.359514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:24.360116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:24.366625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:24.367270 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:24.368608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:24.369412 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:24.487586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:24.488367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:24.496049 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:24.497185 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:24.498520 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:24.499147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:24.511980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.522494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-660f636c-6f04-48f0-b0b7-bb9c49074284 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.166704 Jul 28 17:45:24.523130 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 69/130] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:24 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:24.639078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.649416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.651036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:24.652250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-58e1eaff-4b00-4203-9e83-aea3c5e0663f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.171945 Jul 28 17:45:24.652896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 62/131] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:24 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:25.072839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:25.073560 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:25.079739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.080185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.080951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.081409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.137743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:25.138362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:25.144931 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.145432 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.146196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.146629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.217528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.225122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-81d567d0-0918-461f-aac5-8319887d235e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.156056 Jul 28 17:45:25.225725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 70/132] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:25 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:25.276460 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.284156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2d565dac-3a86-4690-82ea-a4105c6a0c85 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.152415 Jul 28 17:45:25.284659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 63/133] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:25 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:25.544120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:25.544643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:25.551793 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.552257 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.553006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.553470 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.676012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:25.676951 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:25.684415 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.684948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.687276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:25.687733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:25.690418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.699208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-31dd3d81-420d-43be-bf8e-40e7126800b5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.159057 Jul 28 17:45:25.699789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 71/134] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:25 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:25.821463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.830770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.831918 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:25.833028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2ff44675-e616-41a0-a7e9-1c0deb029d69 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.161192 Jul 28 17:45:25.833613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 64/135] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:25 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:26.248006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:26.248791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:26.256681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.257499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.258392 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.258922 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.306677 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:26.307311 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:26.324147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.324512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.325337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.325782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.395307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:26.403282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4b447952-8324-4ceb-9ca6-1799c64fc221 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.159899 Jul 28 17:45:26.403940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 72/136] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:26 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:26.460946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:26.468359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d481256f-6b71-4120-a664-a95b25189885 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.165612 Jul 28 17:45:26.468922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 65/137] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:26 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:26.720951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:26.722131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:26.730192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.730707 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.731541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.732077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.752036 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:26.851465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-4bd10142-907e-4071-8e50-46a144125d08 req-a7b1f70e-2644-4171-bb7c-c7ad70da32f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "name": "network-vif-plugged", "status": "completed", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:26.865674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4bd10142-907e-4071-8e50-46a144125d08 req-a7b1f70e-2644-4171-bb7c-c7ad70da32f5 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.866267 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4bd10142-907e-4071-8e50-46a144125d08 req-a7b1f70e-2644-4171-bb7c-c7ad70da32f5 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.873589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:26.891193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-48c8776a-817e-4428-aae2-5989b26816c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.174941 Jul 28 17:45:26.892560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-4bd10142-907e-4071-8e50-46a144125d08 req-a7b1f70e-2644-4171-bb7c-c7ad70da32f5 service nova] Creating event network-vif-plugged:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:45:26.910506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 73/138] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:26 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:26.918169 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-4bd10142-907e-4071-8e50-46a144125d08 req-a7b1f70e-2644-4171-bb7c-c7ad70da32f5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071017 Jul 28 17:45:26.919479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:26.922639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 66/139] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:26.923009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:26.929839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.930358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:26.931246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:26.931678 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.067295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:27.075331 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:27.076881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:27.078192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c4c52003-72ed-482d-94df-350b3e58db15 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.166542 Jul 28 17:45:27.078755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 74/140] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:26 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:27.425003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:27.425735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:27.431976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.432499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.433301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.433739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.489825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:27.490433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:27.496560 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.497012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.497825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.498261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.565835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:27.568148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:27.574989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d65f445e-a663-4ef8-9656-efefe3734bbd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.154805 Jul 28 17:45:27.575577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 67/141] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:27 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:27.635339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:27.643795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c80c9ebc-3428-4f7a-b23b-a332618a4b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.157798 Jul 28 17:45:27.644359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 75/142] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:27 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:27.917775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:27.918376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:27.924680 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.925129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:27.925907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:27.926334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.059612 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.068070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7c5aabbc-6ec7-4b10-9151-3fc01ae17709 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.154155 Jul 28 17:45:28.068650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 68/143] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:27 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:28.100811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:28.101447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:28.107497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.107945 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.109359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.109757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.244185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.252792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.254341 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.255442 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a1211bd7-2e0d-40f6-a9a9-34371ae22af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.158493 Jul 28 17:45:28.255991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 76/144] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:28 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:28.597800 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:28.598407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:28.604481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.604930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.605719 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.606156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.666369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:28.666982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:28.673346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.673804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.674904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.675649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.735796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.743390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-72601792-654d-4aeb-8cd7-5a96df7d1789 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.149340 Jul 28 17:45:28.743963 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 69/145] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:28 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:28.827503 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:28.835056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8a6de718-42bb-44d7-8a9a-d536b75c181f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.172548 Jul 28 17:45:28.835630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 77/146] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:28 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:28.935239 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-f0ca3793-cc84-4d4c-8f5f-c8dcfb9d2ca4 req-2fa4207b-a0cd-4f30-9cec-ac8d3b0f24e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f84a7a8-29b0-4dfb-a6dd-11e25f978217", "name": "network-vif-plugged", "status": "completed", "tag": "68d3356b-d07b-40b6-8d0a-f9dfbab82c03"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:28.944852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-f0ca3793-cc84-4d4c-8f5f-c8dcfb9d2ca4 req-2fa4207b-a0cd-4f30-9cec-ac8d3b0f24e2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:28.945318 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-f0ca3793-cc84-4d4c-8f5f-c8dcfb9d2ca4 req-2fa4207b-a0cd-4f30-9cec-ac8d3b0f24e2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:28.957006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-f0ca3793-cc84-4d4c-8f5f-c8dcfb9d2ca4 req-2fa4207b-a0cd-4f30-9cec-ac8d3b0f24e2 service nova] Creating event network-vif-plugged:68d3356b-d07b-40b6-8d0a-f9dfbab82c03 for instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 on hv-cinder-81322 Jul 28 17:45:28.961912 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-f0ca3793-cc84-4d4c-8f5f-c8dcfb9d2ca4 req-2fa4207b-a0cd-4f30-9cec-ac8d3b0f24e2 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030345 Jul 28 17:45:28.962472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 70/147] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:29.089462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:29.090206 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:29.097267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.097722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.098495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.098933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.232158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:29.241034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-99f0e9b8-efe6-411b-9616-6ef4216d0ccd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.155470 Jul 28 17:45:29.241646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 78/148] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:29 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:29.278740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:29.279719 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:29.291811 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.292274 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.293180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.293624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.422473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:29.430476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:29.431933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:29.433036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b17e1f27-1cc4-4f4d-9c14-41c8ba0b82b7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.158636 Jul 28 17:45:29.433654 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 71/149] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:29 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:29.765508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:29.766162 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:29.772274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.772723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.773517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.774108 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.857083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:29.858107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:29.871276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.871800 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.872798 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:29.873825 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:29.931559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:29.941147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-db40a705-c5f9-4457-a2a1-20574064e4a6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.178629 Jul 28 17:45:29.942133 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 79/150] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:29 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:30.032588 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:30.043712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-320919ed-c7c1-4fba-bf00-e34e011a2a4f tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.191020 Jul 28 17:45:30.044286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 72/151] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:29 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:30.262907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:30.265508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:30.275108 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.275878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:30.276894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.277524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:30.453019 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:30.459701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:30.460985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:30.461177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-43b1ed74-1327-487f-9182-ab661b065550 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.202611 Jul 28 17:45:30.473213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 80/152] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:30 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:30.473442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.473442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:30.473625 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.476875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:30.663571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:30.673561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:30.675804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:30.677073 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-679b38e3-d54d-48a0-9fc3-f521d8504f71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.225072 Jul 28 17:45:30.677767 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 73/153] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:30 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:30.962485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:30.963079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:30.971544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.972254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:30.973025 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:30.973617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.064997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:31.066284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:31.072395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.073031 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.074154 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.074735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.138971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.147516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5e0c9d09-0071-4f6b-95b1-f64e926dac96 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.188778 Jul 28 17:45:31.148636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 81/154] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:30 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:31.295082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.305263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e797b85c-47fe-4769-b813-1ead4661f756 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.243949 Jul 28 17:45:31.306401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 74/155] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:31 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:31.485207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:31.486434 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:31.495328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.496132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.496963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.497754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.673510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.681084 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aecbb367-e0d5-44ad-ae99-c8ad8c97b5ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.200838 Jul 28 17:45:31.681695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 82/156] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:31 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:31.700504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:31.701106 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:31.707199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.707632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.708389 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:31.708812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:31.899206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.909429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.911172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:31.912470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3a0ed9a1-7435-4d3c-a690-d8cc9740cfdc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.216120 Jul 28 17:45:31.912848 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 75/157] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:31 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:32.172740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:32.173858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:32.179147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.183634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.184238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.185057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.185879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.327783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:32.328408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:32.335007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.336140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.336933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.340189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:32.341698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.350769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1c213b33-cc3d-4a2e-97bb-335674414b18 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.184875 Jul 28 17:45:32.351365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 83/158] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:32 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:32.489607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:32.497022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b81f3fdb-9060-4f21-b292-7fab12d0d686 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.173651 Jul 28 17:45:32.497629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 76/159] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:32 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:32.704495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:32.705697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:32.721647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.721750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.722470 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.722909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.921982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:32.930233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2bf0881c-0c6c-40ea-8279-2aa1d63b681d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.231347 Jul 28 17:45:32.931055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 84/160] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:32 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:32.948686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:32.949361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:32.956430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.957026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:32.958077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:32.958578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.109670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:33.120798 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:33.122547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:33.123650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b7d49c17-6acd-48b9-9857-2ee46f059ea0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.191528 Jul 28 17:45:33.141755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 77/161] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:32 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:33.375612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:33.376323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:33.382370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.382982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.389050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.390112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.519824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:33.521116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:33.528027 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.528150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:33.528561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.529524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.530030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.541039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d928cd53-344a-4ca0-95ae-471a1a79b727 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.170261 Jul 28 17:45:33.541649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 85/162] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:33 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:33.676301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:33.683839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e7aee032-8ce0-403e-ab5f-5b03d4e41492 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.167816 Jul 28 17:45:33.684410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 78/163] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:33 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:33.952915 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:33.953642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:33.959673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.960178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:33.960847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:33.961629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.098846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.106822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aea2db53-a41c-4f01-a7d2-7fa0fdc92595 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.158670 Jul 28 17:45:34.107519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 86/164] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:33 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:34.148435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:34.149035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:34.152015 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=95 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.156442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.156895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.157705 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.158161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.299801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.308467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.310142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.312395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2407a9f7-06b2-47f0-87e0-4babb800d653 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.166874 Jul 28 17:45:34.313237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 79/165] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:34 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:34.562668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:34.563269 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:34.569238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.569690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.570450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.570884 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.706453 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:34.707067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:34.709541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.713429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.713885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.714683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:34.715275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:34.718139 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4d9ea8bb-f227-4a2b-960c-2cc35f42d5c7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.158617 Jul 28 17:45:34.720303 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 87/166] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:34 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:34.863631 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:34.871110 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7a9e975b-74c2-42b6-9091-2d4a8dac78e8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.170233 Jul 28 17:45:34.871760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 80/167] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:34 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:35.128141 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:35.128760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:35.134723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.135424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.136189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.136626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.272917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:35.281116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7eb31108-5cd4-4b9a-b84f-67cd94b27e55 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.156544 Jul 28 17:45:35.281812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 88/168] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:35 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:35.335767 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:35.336374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:35.342387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.343337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.344201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.344632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.529893 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:35.538461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:35.540070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:35.541282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ba7220bd-b440-4e7d-9fa2-49e09408fccc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.209355 Jul 28 17:45:35.541943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 81/169] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:35 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:35.740053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:35.740661 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:35.746563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.747004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.747753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.748178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.887005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:35.892863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:35.894129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:35.896481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-eb8133b3-7dd1-4ca7-94dd-d4eb7f6454bb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.159803 Jul 28 17:45:35.896954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 89/170] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:35 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:35.901560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.902016 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:35.902963 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:35.903570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.046079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:36.054230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-56443742-f34e-4fb3-bfe7-821b4422034b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1315 microversion: 2.1 time: 0.165881 Jul 28 17:45:36.054900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 82/171] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:35 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:36.302936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:36.303545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:36.311151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.312431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.313311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.313756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.323544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.461308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:36.470539 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3c1d4e62-e638-4015-b8b9-42a18a009a8c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1322 microversion: 2.1 time: 0.171314 Jul 28 17:45:36.471715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 90/172] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:36 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:36.568306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:36.568943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:36.575352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.575801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.576565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.577516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.724347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:36.733035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:36.734832 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:36.736018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ed9a2e0b-03b8-4e2a-830b-9b2ef77150f7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.172367 Jul 28 17:45:36.736815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 83/173] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:36 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:36.918120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:36.919368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:36.925636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.926932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:36.929199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:36.930022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.082235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:37.084141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:37.093286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.094593 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.096020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.096612 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.102626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:37.121655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4592324f-280e-4c20-9902-ebdc92c3f688 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.207374 Jul 28 17:45:37.129606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 91/174] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:36 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:37.313955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:37.321649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6b26ab16-04ca-4905-871f-68759c977d5b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1503 microversion: 2.1 time: 0.248862 Jul 28 17:45:37.322298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 84/175] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:37 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:37.506992 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:37.508249 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:37.516353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.517052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.518041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.518634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.760672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:37.761333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:37.769012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.769504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.770995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.771647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.777049 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.777222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:37.785124 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-36dd722b-f855-4f92-9eb8-731dfe54d716 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1515 microversion: 2.1 time: 0.295985 Jul 28 17:45:37.794977 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 92/176] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:37 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:37.839008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:37.845231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:37.860582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.861033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.861838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:37.862267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:37.949492 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lazy-loading 'flavor' on Instance uuid 0a0a7816-0379-49a1-acae-959a72fa36b8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:45:38.042234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:38.058250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:38.062967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:38.065239 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-98286816-6f08-4ced-b326-60712456012c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.308953 Jul 28 17:45:38.066434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 85/177] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:37 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:38.121289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-731da551-4628-4a3d-a040-cc63e9884bc3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8/action" status: 200 len: 32 microversion: 2.1 time: 0.317778 Jul 28 17:45:38.124373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 93/178] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:45:37 2022] POST /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 17:45:38.135056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:38.136221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:38.152308 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:38.152967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:38.153969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:38.155269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:38.157514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:38.158456 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:38.175278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:38.176004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:38.177717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:38.178327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:38.350965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:38.360343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6ed7ceaa-46cb-4a68-96d5-be33971acd6f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.210480 Jul 28 17:45:38.361278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 94/179] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:38 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:38.371778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:38.389084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8919d3dc-3ed1-4cb4-a1f6-1409e2df1a39 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.259084 Jul 28 17:45:38.393686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 86/180] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:38 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:38.990034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3af752-ea89-4043-bd35-4a13c6a80313"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:38.992632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:39.000077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.000221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.001056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.001703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.088327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:39.089013 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:39.099733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.100551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.101734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.102437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.320480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:39.331087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:39.332701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:39.334298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d57983be-ec3e-4e50-8ffb-304c8f358396 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.249631 Jul 28 17:45:39.335428 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 87/181] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:39 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:39.381863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:39.382487 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:39.392915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.393397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.394207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.398121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.650010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:39.661736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-012141a1-79e2-42e2-8308-a6302d4cf55e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1362 microversion: 2.1 time: 0.284050 Jul 28 17:45:39.662331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 88/182] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:39 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:39.666799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:39.667401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:39.684898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.685687 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.688005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:39.688866 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:39.936932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:39.948805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ccc56777-e85c-4b5c-8ecd-340657d9f8e7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.285444 Jul 28 17:45:39.950266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 89/183] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:39 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:40.359114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:40.360078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:40.366053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.366494 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.367246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.367670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.536953 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:40.545078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:40.547244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:40.548337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7cfe02d0-1c79-4b93-95fb-ed62b2efb9ed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1408 microversion: 2.20 time: 0.193622 Jul 28 17:45:40.548901 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 90/184] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:40 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:45:40.687682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:40.688377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:40.695518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.695918 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.696759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.697221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.839249 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:40.847439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-89803e50-c1eb-49ee-98bb-51a10aeef548 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1548 microversion: 2.1 time: 0.163954 Jul 28 17:45:40.847939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 91/185] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:40 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:40.867568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:40.868047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:40.874335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.874785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.875531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:40.875959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:40.997614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c4ad25d2-ad79-4eb5-882b-f1479feb6e2d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133074 Jul 28 17:45:40.998246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 92/186] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:45:40 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:45:41.004667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:41.004667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:41.018079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.018665 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.019553 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.020070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.178839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:41.188315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c4761731-ca60-4f02-b45f-56a1b167d650 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.188946 Jul 28 17:45:41.190430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 93/187] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:40 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:41.466461 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c037f98c-e410-4768-9fb0-d9dd1f6d28da tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "POST /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.480577 Jul 28 17:45:41.467381 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 95/188] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:45:38 2022] POST /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559/os-volume_attachments => generated 194 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:41.571757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:41.572649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:41.579590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.580065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.580839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.581286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.724131 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:41.734607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:41.736861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:41.738260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-90662a09-e58c-41c4-988d-7f887cabbd5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1600 microversion: 2.20 time: 0.170264 Jul 28 17:45:41.738840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 94/189] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:45:41 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:45:41.762171 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:41.762751 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:41.770356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.770801 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.771762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:41.772199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:41.869346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d4aef95e-0bbe-45aa-a90d-1239df639af5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111515 Jul 28 17:45:41.869953 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 96/190] 10.222.0.89 () {60 vars in 1316 bytes} [Thu Jul 28 17:45:41 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:42.212092 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:42.212715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:42.219292 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:42.219743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:42.220544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:42.221392 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:42.422917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-34305ca3-7d78-4e58-8d3c-630b7327da5f req-fb450201-b865-459c-bcf1-a5ea733df3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f84a7a8-29b0-4dfb-a6dd-11e25f978217", "tag": "68d3356b-d07b-40b6-8d0a-f9dfbab82c03"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:42.433720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-34305ca3-7d78-4e58-8d3c-630b7327da5f req-fb450201-b865-459c-bcf1-a5ea733df3bd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:42.434561 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-34305ca3-7d78-4e58-8d3c-630b7327da5f req-fb450201-b865-459c-bcf1-a5ea733df3bd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:42.447423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-34305ca3-7d78-4e58-8d3c-630b7327da5f req-fb450201-b865-459c-bcf1-a5ea733df3bd service nova] Creating event network-changed:68d3356b-d07b-40b6-8d0a-f9dfbab82c03 for instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 on hv-cinder-81322 Jul 28 17:45:42.453521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-34305ca3-7d78-4e58-8d3c-630b7327da5f req-fb450201-b865-459c-bcf1-a5ea733df3bd service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035623 Jul 28 17:45:42.454516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 97/191] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:45:42.762169 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:42.776557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-960ddff5-fa8a-428c-9b0e-e587204a981c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.568421 Jul 28 17:45:42.792175 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 95/192] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:42 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:43.354257 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-4b6bc1e3-ea67-4729-baeb-b9af18c8145e req-dbd6b541-578e-45c5-8962-ab3321a39304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:45:43.366164 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-4b6bc1e3-ea67-4729-baeb-b9af18c8145e req-dbd6b541-578e-45c5-8962-ab3321a39304 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:43.366663 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-4b6bc1e3-ea67-4729-baeb-b9af18c8145e req-dbd6b541-578e-45c5-8962-ab3321a39304 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:43.381358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-4b6bc1e3-ea67-4729-baeb-b9af18c8145e req-dbd6b541-578e-45c5-8962-ab3321a39304 service nova] Creating event network-changed:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:45:43.387512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-4b6bc1e3-ea67-4729-baeb-b9af18c8145e req-dbd6b541-578e-45c5-8962-ab3321a39304 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037570 Jul 28 17:45:43.388795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 98/193] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:45:43.800230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:43.800988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:43.807207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:43.808397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:43.809395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:43.810141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:43.950872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:43.958695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e417d6c0-2235-426d-a73d-8ac8b6972733 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.162753 Jul 28 17:45:43.959271 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 96/194] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:43 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:44.980422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:44.981115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:44.988840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:44.989327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:44.990098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:44.990533 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:45.125212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:45.132911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aa21b895-09d6-4833-9aa1-db05db4a2d87 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.156640 Jul 28 17:45:45.133530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 99/195] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:44 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:46.154125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:46.154629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:46.161702 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:46.162146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:46.162915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:46.163323 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:46.293715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:46.301487 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-34eaac9d-270f-404e-91a6-5f93129b9678 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.151234 Jul 28 17:45:46.302056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 97/196] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:46 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:47.322285 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:47.322887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:47.329577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:47.330017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:47.330771 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:47.331200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:47.470240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:47.478122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-45e682c3-56fb-4e4c-989a-2f89aad68c31 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.159599 Jul 28 17:45:47.478893 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 100/197] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:47 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:48.500695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:48.501452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:48.508592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:48.509047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:48.509880 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:48.510319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:48.648761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:48.657722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-988841a6-c8d9-4e84-b727-f42b25d1dd27 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.161717 Jul 28 17:45:48.658298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 98/198] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:48 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:49.679220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:49.680655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:49.688158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:49.688611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:49.689416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:49.689879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:49.850435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:49.860579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6efa0c04-70eb-430d-a7ea-2e74998c3ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.185148 Jul 28 17:45:49.875194 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 101/199] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:49 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:50.882060 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:50.882669 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:50.890429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:50.891586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:50.892623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:50.893415 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:51.036092 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:51.043360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-abfcc07a-bbb0-464d-b40b-b4e2403189af tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.165237 Jul 28 17:45:51.043920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 99/200] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:50 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:52.064618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:52.065279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:52.071793 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:52.072354 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:52.073005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:52.073469 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:52.208975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:52.217419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-43e6bf1b-49ba-4818-9d71-e39706412145 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.157321 Jul 28 17:45:52.218485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 102/201] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:52 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:53.243533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:53.244160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:53.252148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:53.252581 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:53.253808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:53.254257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:53.416661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:53.424465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5327a10d-4fdd-4cb5-8286-fd073f9bc687 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.185703 Jul 28 17:45:53.425043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 100/202] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:53 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:54.445235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:54.445859 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:54.452835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:54.453317 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:54.454097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:54.454533 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:54.583438 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:54.591187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-63c5dc38-b50e-4b84-a359-24d68ef66995 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.149759 Jul 28 17:45:54.591753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 103/203] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:54 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:55.613869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:55.614350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:55.621506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:55.621857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:55.622688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:55.623189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:55.881304 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:55.907131 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-831933d1-9a92-4760-bb65-9cdb3e8f4274 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.296989 Jul 28 17:45:55.909109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 101/204] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:55 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:56.933668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:56.935033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:56.945447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:56.945895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:56.946725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:56.947153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:57.113517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:57.134455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d29d7781-66bb-4d3a-9373-8b897e693437 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.205774 Jul 28 17:45:57.135262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 104/205] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:56 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:45:58.156718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:58.157381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:58.163554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:58.163999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:58.164774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:58.165257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:58.169594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:58.314896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:58.323842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6842e99b-ed13-4cc5-9f12-4205ab3a9e53 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.170970 Jul 28 17:45:58.324419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 102/206] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:58 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:45:59.349334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:45:59.349919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:45:59.356380 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:59.356819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:59.357597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:45:59.358023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:45:59.362485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:59.492500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:45:59.500685 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c926657b-ed5b-4053-8cf0-8a403032f0a2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.157638 Jul 28 17:45:59.501683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 105/207] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:45:59 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:00.522632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:00.523230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:00.529346 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:00.529790 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:00.531046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:00.531650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:00.661020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:00.668419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-904ee93c-873a-4074-b8b2-fce9a4a59814 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.149647 Jul 28 17:46:00.668988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 103/208] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:00 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:00.950324 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:00.950820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:00.957993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:00.958442 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:00.959214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:00.959648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:00.987150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:46:01.077569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2a43580c-248d-4416-89de-f847c4a84264 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "DELETE /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 204 len: 0 microversion: 2.1 time: 0.130348 Jul 28 17:46:01.081509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 106/209] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:46:00 2022] DELETE /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:01.086653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:01.087386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:01.094945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:01.095397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:01.096197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:01.096627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:01.442857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:01.451151 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c83046c2-501b-4afb-aebb-e0a3d148bf98 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.368320 Jul 28 17:46:01.451717 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 104/210] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:01 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:01.690676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:01.691361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:01.697415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:01.697850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:01.698599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:01.699020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:01.834661 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:01.842306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3405274b-9d46-442e-81f0-eccea2ae4ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.156230 Jul 28 17:46:01.842911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 107/211] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:01 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:02.471877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:02.472538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:02.478698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:02.479147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:02.479904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:02.480336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:02.609434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:02.617500 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b76b70ab-ce9f-40ff-b25e-a314982c9fdd tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.149385 Jul 28 17:46:02.618075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 105/212] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:02 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:02.864629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:02.865273 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:02.867724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:02.881206 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:02.881674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:02.882432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:02.882863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:03.012476 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:03.021261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9456e3eb-62ec-46e5-9691-652720a943ae tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.160388 Jul 28 17:46:03.021836 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 108/213] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:02 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:03.641086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:03.641893 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:03.648195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:03.648637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:03.649441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:03.649872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:03.787344 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:03.795403 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2fd827c5-df59-4c76-9bf2-6e23690e91e4 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.160068 Jul 28 17:46:03.796352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 106/214] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:03 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:04.042365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:04.042998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:04.049595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:04.050037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:04.050794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:04.051222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:04.189602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:04.197279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3c86f538-a27b-4628-8f66-c7041a9d983d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.158697 Jul 28 17:46:04.197853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 109/215] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:04 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:04.817074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:04.817664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:04.831870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=56 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:04.831870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:04.831870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:04.831870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:04.832366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:04.973283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:04.981359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d499850d-d7ad-40cf-9a61-b7bd17bcadf2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.168666 Jul 28 17:46:04.981935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 107/216] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:04 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:05.218598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:05.219202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:05.225897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:05.226337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:05.227088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:05.227519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:05.357356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:05.365492 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-91741e5b-b1be-44a1-b753-e689b62edefc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.151109 Jul 28 17:46:05.366077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 110/217] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:05 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:06.002391 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:06.003005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:06.009377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:06.009822 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:06.010585 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:06.011269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:06.147109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:06.155155 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e5bc5160-3b5f-406c-ad31-a5fe4192ac17 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.156727 Jul 28 17:46:06.156164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 108/218] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:05 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:06.387303 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:06.387908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:06.394777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:06.395166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:06.395937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:06.396459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:06.525412 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:06.533579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-33174e4c-6f4a-4f04-b1a4-a640b966fc8a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.150337 Jul 28 17:46:06.534154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 111/219] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:06 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:07.176938 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:07.177506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:07.183560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:07.184005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:07.184765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:07.185234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:07.315714 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:07.323577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3452bf87-4cda-4a59-a43d-52cb7cc620d9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.150564 Jul 28 17:46:07.324145 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 109/220] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:07 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:07.555628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:07.556258 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:07.563482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:07.563924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:07.564681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:07.565113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:07.700049 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:07.707487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-757e6b55-77d0-4071-98e7-3e3ee320de3e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.155713 Jul 28 17:46:07.708054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 112/221] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:07 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:08.346549 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:08.347269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:08.355327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:08.355783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:08.356929 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:08.357624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:08.512735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:08.521695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5f260dcb-9139-4634-a39a-269412587e77 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.180442 Jul 28 17:46:08.522313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 110/222] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:08 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:08.728110 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:08.728789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:08.734963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:08.735419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:08.736209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:08.736642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:08.898835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:08.911720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3f9456ea-88d8-4ba6-a941-c1b4ebd0e084 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.187808 Jul 28 17:46:08.912312 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 113/223] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:08 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:09.544369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:09.545011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:09.552024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:09.552579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:09.553436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:09.553982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:09.769129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:09.777240 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2628ac0e-098c-4b11-af4a-2c4de71d339a tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.236633 Jul 28 17:46:09.777705 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 111/224] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:09 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:09.933189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:09.933796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:09.942623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:09.942623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:09.942623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:09.942623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:10.106973 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:10.129407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-326fa32a-eace-41ac-8682-3734e199f320 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.189378 Jul 28 17:46:10.129407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 114/225] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:09 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:10.799134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:10.799928 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:10.806195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:10.806843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:10.807597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:10.808255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:11.059117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:11.068609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-07fbb99b-9590-4485-85ad-12b3e03cf2c8 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1555 microversion: 2.1 time: 0.273839 Jul 28 17:46:11.069407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 112/226] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:10 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:11.140820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:11.141467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:11.153128 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:11.153806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:11.154825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:11.155381 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:11.237395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-d126eaab-0233-45fe-923d-35d0b31fab9d req-b67c2c6d-a4f7-4463-95b9-5dafa117518e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df8eb85-99c9-46db-8ffc-313f53d8a559", "name": "network-vif-deleted", "tag": "59e7f4e7-e3a7-4a27-b67d-dea37480a3a0"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:11.254110 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-d126eaab-0233-45fe-923d-35d0b31fab9d req-b67c2c6d-a4f7-4463-95b9-5dafa117518e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:11.254563 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-d126eaab-0233-45fe-923d-35d0b31fab9d req-b67c2c6d-a4f7-4463-95b9-5dafa117518e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:11.283038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-d126eaab-0233-45fe-923d-35d0b31fab9d req-b67c2c6d-a4f7-4463-95b9-5dafa117518e service nova] Creating event network-vif-deleted:59e7f4e7-e3a7-4a27-b67d-dea37480a3a0 for instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 on hv-cinder-81322 Jul 28 17:46:11.290133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-d126eaab-0233-45fe-923d-35d0b31fab9d req-b67c2c6d-a4f7-4463-95b9-5dafa117518e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057995 Jul 28 17:46:11.292129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 113/227] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:46:11.362518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:11.370294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-607b02a4-45b5-4378-8cab-5624f625d148 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.234230 Jul 28 17:46:11.371532 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 115/228] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:11 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:12.093758 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:12.094570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:12.103073 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:12.104078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:12.104376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:12.104728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:12.175897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:12.189778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6ecc56f1-86f2-4198-9c42-565df4054007 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1513 microversion: 2.1 time: 0.100578 Jul 28 17:46:12.190739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 114/229] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:12 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1513 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:12.392580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:12.394802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:12.401748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:12.402199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:12.402963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:12.403411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:12.557238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:12.565595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-45594e70-103c-45f6-ac60-fefe527c8396 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.177286 Jul 28 17:46:12.566440 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 116/230] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:12 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:13.215471 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:13.216170 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:13.224036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:13.224486 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:13.225290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:13.228498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:13.309128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:13.326829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7c06a928-e9bd-43d9-b62e-4a97af2a511b tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1513 microversion: 2.1 time: 0.117480 Jul 28 17:46:13.328993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 115/231] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:13 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1513 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:13.589729 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:13.590934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:13.600233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:13.601026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:13.602069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:13.602816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:13.740585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:13.748337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-99c4c5eb-3cfe-4ead-863f-ed072fcea83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.164759 Jul 28 17:46:13.748881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 117/232] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:13 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:14.350329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:14.353119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:14.359948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:14.360841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:14.361826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:14.362246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:14.447254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:14.457422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cdcd6fea-5d9d-4b35-aab6-5d457b315b07 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1346 microversion: 2.1 time: 0.110770 Jul 28 17:46:14.458610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 116/233] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:14 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:14.770151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:14.770856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:14.778664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:14.779113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:14.779892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:14.780356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:14.929320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:14.938116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a7c02fc6-9be3-416b-a9fd-5a5d9063ee5c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.171734 Jul 28 17:46:14.938884 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 118/234] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:14 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:15.479176 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:15.479864 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:15.485906 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:15.486347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:15.487104 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:15.487531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:15.548582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:15.556488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-53e703f0-5010-4fc1-93a0-de3764d82037 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1346 microversion: 2.1 time: 0.081210 Jul 28 17:46:15.557055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 117/235] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:15 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:15.959665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:15.960276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:15.967785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:15.968374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:15.969436 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:15.970193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:16.109742 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:16.117785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-11b19f32-c7f5-49aa-9f3c-bb1e58d8ca08 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1521 microversion: 2.1 time: 0.161964 Jul 28 17:46:16.118363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 119/236] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:15 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:16.579113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:16.579615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:16.586057 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:16.586566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:16.587408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:16.587900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:16.618399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:16.618843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:16.619302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lazy-loading 'fault' on Instance uuid 8df8eb85-99c9-46db-8ffc-313f53d8a559 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:16.665379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:16.673318 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a8174f11-c23e-4116-a5c6-9bc7341426c1 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1351 microversion: 2.1 time: 0.099056 Jul 28 17:46:16.673898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 118/237] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:16 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:17.140119 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:17.140737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:17.147377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.147823 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.148590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.149023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.152972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:17.282925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:17.290416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bb31408d-f019-4aad-84b1-9e7c3be9baeb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1501 microversion: 2.1 time: 0.154676 Jul 28 17:46:17.290982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 120/238] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:17 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:17.310638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:17.311302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:17.317490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.317939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.318703 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.319141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.321829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:17.452698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:17.460305 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f5c7d649-3998-4e05-9c00-d61e29cde938 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1516 microversion: 2.1 time: 0.153510 Jul 28 17:46:17.460871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 119/239] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:17 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:17.694339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:17.694930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:17.701235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.701679 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.703309 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.703842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.734486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:17.734934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:17.735391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lazy-loading 'fault' on Instance uuid 8df8eb85-99c9-46db-8ffc-313f53d8a559 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:17.793965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:17.803622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dae377f1-84d5-4cbb-969e-a3ca6db24d64 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1351 microversion: 2.1 time: 0.113215 Jul 28 17:46:17.804459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 121/240] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:17 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:18.825173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:18.825822 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:18.832912 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:18.833404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:18.834182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:18.834618 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:18.867772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:18.868149 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:18.868576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lazy-loading 'fault' on Instance uuid 8df8eb85-99c9-46db-8ffc-313f53d8a559 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:18.909530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:18.917606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b5f96172-0a7a-4902-aeb6-b492375a3a51 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1351 microversion: 2.1 time: 0.096239 Jul 28 17:46:18.918183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 120/241] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:18 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:19.939513 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:19.940223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:19.947042 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:19.947570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:19.948434 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:19.948942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:19.985542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:19.986094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:19.986638 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lazy-loading 'fault' on Instance uuid 8df8eb85-99c9-46db-8ffc-313f53d8a559 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:20.035074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed334d56f34486ebd8b52247d060856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6018db8e046e4945be4dd56ff8e8eeea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:20.042567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-43f92172-cf69-42e3-aeb9-54e06ab2edf9 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 200 len: 1305 microversion: 2.1 time: 0.107686 Jul 28 17:46:20.043459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 122/242] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:19 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:20.986454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:20.988254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:20.994713 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:20.994713 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:20.995486 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:20.995918 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.020158 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lazy-loading 'flavor' on Instance uuid c00daefb-7ad3-4334-8db5-47043d2c2c09 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:21.067595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:21.068344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:21.075305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.076049 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.077835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.078496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.096446 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] HTTP exception thrown: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Request method failure captured: Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 HTTP/1.1 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssNj3bIp6SFri0omatmxrFgkOSA4jYJlbjKTUGcOV_BeJ7GSILKdRLNTc6xK4yMuhCWSIKUOk4NYf49QaBHF6hSLJPf7W6SUIJwrhbfZ9ABM5rOpoeif2n1zqP34lTaNnCe4jIb0rqh1vqxat8q1nHUR6YMTxo07dfgerDmcwtVwx4 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:46:21.101244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 6ed334d56f34486ebd8b52247d060856 Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.102777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '8df8eb85-99c9-46db-8ffc-313f53d8a559'} Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:46:21.103593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.105053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.106259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Returning 404 to user: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:46:21.106259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fca6bf0f-62d0-4c4f-92af-40173fb02f6d tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 404 len: 111 microversion: 2.1 time: 0.040781 Jul 28 17:46:21.106652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 123/243] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:21 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:46:21.168057 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-711839ad-fb68-4ac0-aed5-4df8fe113fdb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/action" status: 200 len: 32 microversion: 2.1 time: 0.186303 Jul 28 17:46:21.168899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 121/244] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:46:20 2022] POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:46:21.180695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:21.181852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:21.192870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.193370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.194414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.195003 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.269663 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:21.273327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:21.286251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.286888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.287735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:21.288264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:21.301988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] HTTP exception thrown: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Request method failure captured: Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559/os-volume_attachments HTTP/1.1 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssNj3bIp6SFri0omatmxrFgkOSA4jYJlbjKTUGcOV_BeJ7GSILKdRLNTc6xK4yMuhCWSIKUOk4NYf49QaBHF6hSLJPf7W6SUIJwrhbfZ9ABM5rOpoeif2n1zqP34lTaNnCe4jIb0rqh1vqxat8q1nHUR6YMTxo07dfgerDmcwtVwx4 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:46:21.307097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 6ed334d56f34486ebd8b52247d060856 Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.317404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'server_id': '8df8eb85-99c9-46db-8ffc-313f53d8a559'} Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:46:21.318671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:21.319796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:21.322372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Returning 404 to user: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:46:21.323372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-200dc28b-66f4-411d-b24e-03d1768539f2 tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057999 Jul 28 17:46:21.324192 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 122/245] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:46:21 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:46:21.412662 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:21.422333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1d01de23-9828-490f-a855-f578ea0e7788 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.246814 Jul 28 17:46:21.423687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 124/246] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:21 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:22.448855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:22.449731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:22.456827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.457313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.458088 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.458523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.599306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:22.599789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:22.604420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:22.606181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.606810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.607586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.608017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.613392 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b01a2b4d-31a8-4e45-ab43-26e429fe6e56 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.168774 Jul 28 17:46:22.614121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 123/247] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:22 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:22.622782 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] HTTP exception thrown: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Request method failure captured: Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 HTTP/1.1 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssNj3bIp6SFri0omatmxrFgkOSA4jYJlbjKTUGcOV_BeJ7GSILKdRLNTc6xK4yMuhCWSIKUOk4NYf49QaBHF6hSLJPf7W6SUIJwrhbfZ9ABM5rOpoeif2n1zqP34lTaNnCe4jIb0rqh1vqxat8q1nHUR6YMTxo07dfgerDmcwtVwx4 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:46:22.624918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 6ed334d56f34486ebd8b52247d060856 Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.626543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '8df8eb85-99c9-46db-8ffc-313f53d8a559'} Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:46:22.627890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.629151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.630441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Returning 404 to user: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:46:22.630441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-764496e5-afee-472c-8c84-5cec0e4e12cb tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "DELETE /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 404 len: 111 microversion: 2.1 time: 0.030994 Jul 28 17:46:22.630441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 125/248] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:46:22 2022] DELETE /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:46:22.635147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:22.635859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] [instance: 8df8eb85-99c9-46db-8ffc-313f53d8a559] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:22.642350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.642798 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.643566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:22.644002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:22.657072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] HTTP exception thrown: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Request method failure captured: Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 HTTP/1.1 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssNj3bIp6SFri0omatmxrFgkOSA4jYJlbjKTUGcOV_BeJ7GSILKdRLNTc6xK4yMuhCWSIKUOk4NYf49QaBHF6hSLJPf7W6SUIJwrhbfZ9ABM5rOpoeif2n1zqP34lTaNnCe4jIb0rqh1vqxat8q1nHUR6YMTxo07dfgerDmcwtVwx4 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:46:22.659205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6018db8e046e4945be4dd56ff8e8eeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 6018db8e046e4945be4dd56ff8e8eeea Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-DeleteServersTestJSON-275363342 Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 6ed334d56f34486ebd8b52247d060856 Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-DeleteServersTestJSON-275363342-project Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.660627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '8df8eb85-99c9-46db-8ffc-313f53d8a559'} Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:46:22.661546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. Jul 28 17:46:22.662941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:22.664295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] Returning 404 to user: Instance 8df8eb85-99c9-46db-8ffc-313f53d8a559 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:46:22.664295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d6aaa66d-52d1-4d3c-8193-379376285bde tempest-DeleteServersTestJSON-275363342 tempest-DeleteServersTestJSON-275363342-project] 10.222.0.89 "GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559" status: 404 len: 111 microversion: 2.1 time: 0.029288 Jul 28 17:46:22.664295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 124/249] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:22 2022] GET /compute/v2.1/servers/8df8eb85-99c9-46db-8ffc-313f53d8a559 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:46:23.635481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:23.636871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:23.645468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:23.645965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:23.646741 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:23.647173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:23.787048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:23.794595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-34bbdfcf-d1ad-4633-95bc-f80a845d080a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.162957 Jul 28 17:46:23.795173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 126/250] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:23 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:24.816226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:24.816823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:24.823661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:24.824335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:24.825378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:24.825981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:25.066132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:25.074468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-aa124017-84ec-4719-8451-0749742877d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.262423 Jul 28 17:46:25.075043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 125/251] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:24 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:26.098875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:26.099487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:26.109807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:26.110511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:26.111508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:26.112138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:26.409736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:26.417467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-396f880e-5886-4bac-88bf-5652f5f0256a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.322383 Jul 28 17:46:26.418034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 127/252] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:26 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:27.440840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:27.442851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:27.448791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:27.449345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:27.450119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:27.450724 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:27.591155 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:27.600077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-be2018ad-abd2-42af-94b5-5f0d2bdf283c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.164220 Jul 28 17:46:27.600657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 126/253] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:27 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:28.621883 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:28.625112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:28.633868 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:28.634308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:28.635153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:28.635588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:28.961863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:28.969878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3ef80dc6-8e13-4039-b8d5-f167fa02137b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.351887 Jul 28 17:46:28.970444 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 128/254] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:28 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:29.991449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:29.992055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:29.999767 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:30.000525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:30.001410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:30.001844 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:30.471316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:30.486750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6d2956fb-144b-48b4-aa2f-2cdb74ddd4f1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.498656 Jul 28 17:46:30.489595 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 127/255] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:29 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:31.510599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:31.511213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:31.518769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:31.519220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:31.519988 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:31.520424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:31.676166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:31.685072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-73234018-6c66-46ba-82a2-91594ce99ce2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.178208 Jul 28 17:46:31.685599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 129/256] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:31 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:32.707548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:32.708152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:32.716449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:32.716897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:32.718651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:32.719379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:32.922056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:32.931398 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-30c95b39-3637-4071-aa6c-f2c74dd48b02 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.228626 Jul 28 17:46:32.931937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 128/257] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:32 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:33.956315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:33.956922 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:33.959274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=48 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:33.965271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:33.965942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:33.966871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:33.967496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:34.111872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:34.121397 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-76ed52ab-c6b6-4fff-8aa8-35ec6a740f70 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.168806 Jul 28 17:46:34.122105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 130/258] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:33 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:35.144885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:35.146294 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:35.149607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=48 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:35.153628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:35.154074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:35.154837 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:35.155773 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:35.294211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:35.302531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1e08d63d-71dd-4329-8693-59a518ba0985 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.161808 Jul 28 17:46:35.303096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 129/259] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:35 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:36.325690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:36.327327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:36.336122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:36.336579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:36.337493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:36.338146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:36.479654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:36.493362 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-91a1bc3a-f24c-4286-9f54-c3394a21ee37 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.168154 Jul 28 17:46:36.493362 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 131/260] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:36 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:37.509426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:37.510046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:37.516855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:37.517345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:37.518115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:37.518550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:37.661184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:37.669132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2872c453-7cd8-4c8a-b81c-500d2d7f9f9a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.163586 Jul 28 17:46:37.669730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 130/261] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:37 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:38.691192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:38.692323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:38.699013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.699473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:38.700247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.700676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:38.854554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:38.880210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ea732052-1f23-41c7-83d8-b0a99e38cd54 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1502 microversion: 2.1 time: 0.192789 Jul 28 17:46:38.884473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 132/262] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:38 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:38.908920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd527cd-e310-4cd7-b6c4-e8badaca61c9"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:38.911698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:38.919913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.920563 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:38.921436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.922116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:38.948027 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] HTTP exception thrown: Cannot 'attach_volume' instance c00daefb-7ad3-4334-8db5-47043d2c2c09 while it is in vm_state rescued Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Request method failure captured: Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/os-volume_attachments HTTP/1.1 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 74 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssD9OJJzzVfPx5S_-itysl29heH3jm_R51nRL0_U21QoHQjQFI_mITdJuD3ZXDjocSXncShXuQtbfpAKwkKvmB9E0hOSOiO5Pgc591kcL0cquikobxlrYwQjVQPZQDslrW6oum9fkIfZs68nFoWSuqPTrNr-eQf14Y66ZdN5hc39_g Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:46:38.950039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_f5332e245b754728b04af219fdb6ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 14327b8153ab4de782d4bcfef7681fc1 Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {"volumeAttachment": {"volumeId": "5fd527cd-e310-4cd7-b6c4-e8badaca61c9"}} Jul 28 17:46:38.951578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Cannot 'attach_volume' instance c00daefb-7ad3-4334-8db5-47043d2c2c09 while it is in vm_state rescued Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'server_id': 'c00daefb-7ad3-4334-8db5-47043d2c2c09', 'body': {'volumeAttachment': {'volumeId': '5fd527cd-e310-4cd7-b6c4-e8badaca61c9'}}} Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:46:38.952819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c00daefb-7ad3-4334-8db5-47043d2c2c09 while it is in vm_state rescued Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:46:38.954041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:46:38.955067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:46:38.955067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:46:38.955067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c00daefb-7ad3-4334-8db5-47043d2c2c09 while it is in vm_state rescued Jul 28 17:46:38.955067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:46:38.956603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Returning 409 to user: Cannot 'attach_volume' instance c00daefb-7ad3-4334-8db5-47043d2c2c09 while it is in vm_state rescued {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:46:38.957756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-76c99d7d-e170-4aad-876c-98d109b559f2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054600 Jul 28 17:46:38.958306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 131/263] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:46:38 2022] POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 17:46:38.968516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:38.969142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:38.975985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.976547 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:38.977343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:38.977857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:39.070349 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0931463f-280f-4ae4-ad5a-09ee7132bd46 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/action" status: 202 len: 0 microversion: 2.1 time: 0.106454 Jul 28 17:46:39.073779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 133/264] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:46:38 2022] POST /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:46:39.079774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:39.080669 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:39.086771 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:39.087221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:39.087985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:39.088594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:39.330621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:39.339207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ba16382e-f8ba-4d84-b9c7-3e51f432032c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1510 microversion: 2.1 time: 0.263615 Jul 28 17:46:39.339947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 132/265] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:39 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:40.361600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:40.362319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:40.369532 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:40.370232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:40.371017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:40.371455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:40.534269 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:40.542979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fabde229-60e3-4a62-b716-83e090409d58 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1510 microversion: 2.1 time: 0.186930 Jul 28 17:46:40.543561 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 134/266] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:40 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:40.969810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-869617100", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:41.032992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] validate_networks() for None {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:46:41.362493 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:46:41.362906 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:46:41.363374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:46:41.363776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:46:41.364178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:46:41.374046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:41.374913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:41.375725 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:41.376354 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:41.401272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Getting quotas for project a83427bbf87f4dbe9e3533033c075c9e. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:46:41.406544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Getting quotas for user 902d3de9354b4eefb3d99b6e91432c74 and project a83427bbf87f4dbe9e3533033c075c9e. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:46:41.417903 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:46:41.420313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:46:41.480910 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9e962cc5-c044-4ed0-a423-a9c285382716 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516885 Jul 28 17:46:41.481886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 133/267] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:46:41.493274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-da433767-1958-465e-948b-13c80d62d406 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:41.494400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-da433767-1958-465e-948b-13c80d62d406 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:41.559522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-da433767-1958-465e-948b-13c80d62d406 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:41.566206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:41.569552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:41.578808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-da433767-1958-465e-948b-13c80d62d406 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1214 microversion: 2.1 time: 0.087937 Jul 28 17:46:41.581497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 135/268] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:41 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:41.583978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:41.584516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:41.585539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:41.586181 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:41.801637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:41.810311 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-10a8c047-5072-42fb-a2b0-a7b7efa460bb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1510 microversion: 2.1 time: 0.249079 Jul 28 17:46:41.811189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 134/269] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:41 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:42.605323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:42.613975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:42.626617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:42.627288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:42.628069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:42.628624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:42.702733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:42.711826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b9aed6d0-6ed8-48e9-b348-e7d501de8b5b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1218 microversion: 2.1 time: 0.111827 Jul 28 17:46:42.712928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 136/270] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:42 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:42.834720 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:42.835431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:42.842603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:42.843069 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:42.845106 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:42.845793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:42.999532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:43.002133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.010222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d9f26609-3788-41e0-b888-a6ec0b654331 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1516 microversion: 2.1 time: 0.180975 Jul 28 17:46:43.026184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 135/271] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:42 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:43.734879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:43.735686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:43.742305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:43.743252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:43.744488 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:43.745018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:43.772828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.834305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:43.850016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bc1de610-b093-40c4-b53c-9c83f42ae62b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1272 microversion: 2.1 time: 0.119825 Jul 28 17:46:43.851039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 137/272] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:43 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:44.407070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a7341c07-4749-4889-bce5-f77c97da5ebb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: .version_select at 0x7fce3b1a00d0>, body: {"keypair": {"name": "tempest-keypair-720749023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAozweQnfDMXuMdYPCMaiPuMmolg0VtUF1mfXgbRnTvKrlD6pMVraevS65aBlNpAYwkCO3Q5kjstMCHsxBOHeiYRtgZzIkW8uo5ay66ER7i+c9/qPF14M0uRCC3DVxJ5fw=="}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:44.594314 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-a7341c07-4749-4889-bce5-f77c97da5ebb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for project f5332e245b754728b04af219fdb6ca93. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:46:44.603620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-a7341c07-4749-4889-bce5-f77c97da5ebb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for user 14327b8153ab4de782d4bcfef7681fc1 and project f5332e245b754728b04af219fdb6ca93. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:46:44.666458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a7341c07-4749-4889-bce5-f77c97da5ebb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263650 Jul 28 17:46:44.667178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 136/273] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:46:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:46:44.873641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:44.875455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:44.882785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:44.883314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:44.884157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:44.884790 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:45.063715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:45.071808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-59a46125-f657-4c6e-8afa-ba14cc58fc92 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.203521 Jul 28 17:46:45.072463 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 138/274] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:44 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:46.094422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:46.095113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:46.102020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:46.102476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:46.103250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:46.103889 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:46.140351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-540760982", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c5bc62a-37b3-4ec7-a921-dd776df143f3"}], "security_groups": [{"name": "tempest-securitygroup--394216225"}], "key_name": "tempest-keypair-720749023", "user_data": "}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:46.259630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] validate_networks() for [('6c5bc62a-37b3-4ec7-a921-dd776df143f3', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:46:46.329465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:46.338437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-32bb283a-0037-4689-a827-1de80957ca4e tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.249138 Jul 28 17:46:46.339607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 137/275] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:46 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:46.680208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-d213e689-a6ed-4825-83dd-20293d865b52 req-73d27d5a-b975-4b59-89cf-a595a9a96e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6", "tag": "40c84c19-960a-4aca-8c08-e0f50f24a49c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:46.681813 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:46:46.682239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:46:46.682711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:46:46.683122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:46:46.683536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:46:46.692327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-d213e689-a6ed-4825-83dd-20293d865b52 req-73d27d5a-b975-4b59-89cf-a595a9a96e96 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:46.693341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-d213e689-a6ed-4825-83dd-20293d865b52 req-73d27d5a-b975-4b59-89cf-a595a9a96e96 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:46.693459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:46.693802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:46.694609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:46.695112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:46.707132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-d213e689-a6ed-4825-83dd-20293d865b52 req-73d27d5a-b975-4b59-89cf-a595a9a96e96 service nova] Creating event network-changed:40c84c19-960a-4aca-8c08-e0f50f24a49c for instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 on hv-cinder-81322 Jul 28 17:46:46.712747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-d213e689-a6ed-4825-83dd-20293d865b52 req-73d27d5a-b975-4b59-89cf-a595a9a96e96 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036158 Jul 28 17:46:46.713517 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 138/276] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:46:46.721480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:46:46.725890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Getting quotas for user 14327b8153ab4de782d4bcfef7681fc1 and project f5332e245b754728b04af219fdb6ca93. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:46:46.737656 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:46:46.739945 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:46:46.794648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6e2565e9-1dac-4e0e-bcc0-ab2cac4b5dab tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.660023 Jul 28 17:46:46.796157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 139/277] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:46:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 17:46:46.807577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c36d3446-8183-4c96-8759-b8105e18aa2c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:46.808236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c36d3446-8183-4c96-8759-b8105e18aa2c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:46.873536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c36d3446-8183-4c96-8759-b8105e18aa2c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:46.882262 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c36d3446-8183-4c96-8759-b8105e18aa2c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1244 microversion: 2.1 time: 0.078703 Jul 28 17:46:46.897041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 139/278] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:46 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:47.361386 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:47.362045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:47.368189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:47.368634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:47.369417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:47.369939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:47.524275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:47.538878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f3136b59-e653-4621-8609-1874b632c5d5 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.182422 Jul 28 17:46:47.539566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 140/279] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:47 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:47.903913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:47.904474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:47.912905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:47.913399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:47.914177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:47.914616 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:48.005455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:48.014279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8e074cfa-6dd7-4c8e-9c4f-4566468e66cb tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1296 microversion: 2.1 time: 0.114286 Jul 28 17:46:48.027944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 140/280] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:47 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:48.563331 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:48.563331 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:48.567439 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:48.567885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:48.568639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:48.569066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:48.713826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:48.722282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-de24664c-caf3-4b02-9795-2f08156d9a75 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.166436 Jul 28 17:46:48.723038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 141/281] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:48 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:49.039346 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:49.039984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:49.047010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:49.047760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:49.048527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:49.048965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:49.114498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:49.121895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dfd0aac7-8853-4239-8dfb-beed1612b6bc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1314 microversion: 2.1 time: 0.086615 Jul 28 17:46:49.122463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 141/282] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:49 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1314 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:49.745944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:49.746434 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:49.753064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:49.754020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:49.754792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:49.755220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:49.921300 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:49.928926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1df542e1-4330-4977-89f3-289877d5cf84 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.187310 Jul 28 17:46:49.929585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 142/283] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:49 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:50.145739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:50.146594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:50.154018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.154652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:50.156117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.156584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:50.246083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:50.254228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-446ae6ca-51bb-4651-9d40-26a856c368ba tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1302 microversion: 2.1 time: 0.113025 Jul 28 17:46:50.254883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 142/284] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:50 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:50.397819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:50.398299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:50.404737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.406134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:50.407527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.408199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:50.441059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-faff5d38-f859-4a1b-a239-1e1e48bb7e88 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/ips" status: 200 len: 145 microversion: 2.1 time: 0.051715 Jul 28 17:46:50.441755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 143/285] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:46:50 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/ips => generated 145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:46:50.951630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:50.953579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:50.966735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.970885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:50.972111 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:50.972890 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.051588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:51.052150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:51.061031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:51.062197 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.063253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:51.063862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.098374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d0afd68c-9e69-4934-adb7-3ba4e8301874 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/ips" status: 200 len: 152 microversion: 2.20 time: 0.050570 Jul 28 17:46:51.099214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 144/286] 10.222.0.89 () {60 vars in 1289 bytes} [Thu Jul 28 17:46:51 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:46:51.276959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:51.278116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:51.290135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:51.292531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.293593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:51.294243 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.323615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:51.337278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3883aaac-58f6-4354-a803-80f04c6b001d tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.388941 Jul 28 17:46:51.349221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 143/287] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:50 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:51.505072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-bc7cc894-1510-456a-a69b-5f4f030c8002 req-9af4e33f-39f0-480d-8021-ac236754a898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:51.519817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.525876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-bc7cc894-1510-456a-a69b-5f4f030c8002 req-9af4e33f-39f0-480d-8021-ac236754a898 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:51.533112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-bc7cc894-1510-456a-a69b-5f4f030c8002 req-9af4e33f-39f0-480d-8021-ac236754a898 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:51.559999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-bc7cc894-1510-456a-a69b-5f4f030c8002 req-9af4e33f-39f0-480d-8021-ac236754a898 service nova] Creating event network-changed:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:46:51.571622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-bc7cc894-1510-456a-a69b-5f4f030c8002 req-9af4e33f-39f0-480d-8021-ac236754a898 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069633 Jul 28 17:46:51.581413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 144/288] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:46:51.645924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:51.654671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-daf1af31-26bb-4585-8a11-a5ecefd091d6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.381727 Jul 28 17:46:51.659475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 145/289] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:51 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:52.366050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:52.366848 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:52.375348 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:52.375961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:52.377037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:52.377661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:52.537674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:52.550810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c7a89ca8-f81d-4ded-be82-08b32e373239 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.190329 Jul 28 17:46:52.551705 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 145/290] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:52 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:52.682859 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:52.683637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:52.691147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:52.691905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:52.693652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:52.694505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:52.903858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:52.915900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-574b7feb-a13c-4453-835c-2745f7ff0ee4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.237086 Jul 28 17:46:52.916735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 146/291] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:52 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:53.461375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-c44dcace-7aee-4187-ab66-30d031045676 req-de36b7f0-b38b-4cda-b9a4-82b8c14c8493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6", "name": "network-vif-plugged", "status": "completed", "tag": "40c84c19-960a-4aca-8c08-e0f50f24a49c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:53.472595 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c44dcace-7aee-4187-ab66-30d031045676 req-de36b7f0-b38b-4cda-b9a4-82b8c14c8493 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.473037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c44dcace-7aee-4187-ab66-30d031045676 req-de36b7f0-b38b-4cda-b9a4-82b8c14c8493 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.488791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-c44dcace-7aee-4187-ab66-30d031045676 req-de36b7f0-b38b-4cda-b9a4-82b8c14c8493 service nova] Creating event network-vif-plugged:40c84c19-960a-4aca-8c08-e0f50f24a49c for instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 on hv-cinder-81322 Jul 28 17:46:53.495160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-c44dcace-7aee-4187-ab66-30d031045676 req-de36b7f0-b38b-4cda-b9a4-82b8c14c8493 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036708 Jul 28 17:46:53.496393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 146/292] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:46:53.573888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:53.574510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:53.583937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.584676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.585701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.586393 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.797417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:53.803883 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-78bb2d12-60bf-43f4-9d10-9aa5c759c6ee tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.233619 Jul 28 17:46:53.805443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 147/293] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:53 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:53.948673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:53.949739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:53.958348 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.958808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.959601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.960039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.960686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:53.961540 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:53.971834 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.972635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:53.982993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:53.984352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.020359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lazy-loading 'flavor' on Instance uuid b5b7bb8c-4218-4d08-a7d6-9c91343649a8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:46:54.217046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:54.227032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dcedcb9b-703d-499d-baea-15c4c525d8d9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.283707 Jul 28 17:46:54.228183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 147/294] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:53 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:54.234135 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd0437e5-73c3-42d9-8208-2f4bf58cc11a"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:54.237006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:54.253911 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.255862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.257145 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4777954c-a98b-411a-9227-a27461bb0dcf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/action" status: 202 len: 0 microversion: 2.20 time: 0.304368 Jul 28 17:46:54.258066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 148/295] 10.222.0.89 () {62 vars in 1319 bytes} [Thu Jul 28 17:46:53 2022] POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:54.262789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.263297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.269019 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:54.269882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:54.278039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.278556 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.279600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.280886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.449491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:54.460475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:54.462433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:54.463803 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9a2c5e2c-0507-46c1-acfd-16a6360e9567 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.199801 Jul 28 17:46:54.465748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 149/296] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:46:54 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:46:54.706489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0c2a584d-b48b-408d-9656-084de7a43da2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476004 Jul 28 17:46:54.707172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 148/297] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:46:54 2022] POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:46:54.828262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:54.829764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:54.836527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.836907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:54.837811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:54.838504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:55.020920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:55.029511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8d912192-291c-422d-a608-d0733b2269d2 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.206583 Jul 28 17:46:55.030122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 150/298] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:54 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:55.251991 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:55.255443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:55.266760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:55.267298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:55.268388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:55.269386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:55.443661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:55.454848 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a5c055f0-3d6f-4e21-9b53-ab731b2d0096 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.210097 Jul 28 17:46:55.455434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 149/299] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:55 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:55.492077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:55.492782 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:55.499989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:55.500528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:55.501585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:55.502225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:55.749604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:55.767585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:55.769143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:55.770468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-225c7b98-a6b7-403d-8e90-c343e8ea81b3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.282664 Jul 28 17:46:55.771210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 151/300] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:46:55 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:46:56.057250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:56.057876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:56.065596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.066038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.066803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.067298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.228671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.240673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7423d5c7-bb0b-48b5-9613-45e31d597d2b tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1463 microversion: 2.1 time: 0.187328 Jul 28 17:46:56.243535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 150/301] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:56 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:56.305534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:56.307208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:56.315629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.316389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.317412 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.318045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.356838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:46:56.400230 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.472819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c90f9772-f951-4dcb-ba40-317ed0f23a76 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "DELETE /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 204 len: 0 microversion: 2.1 time: 0.171351 Jul 28 17:46:56.474286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 152/302] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:46:56 2022] DELETE /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:56.485551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:56.487043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:56.488560 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:56.489328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:56.501431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.501888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.502695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.503416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.515901 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.516381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.517221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.517669 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.697346 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.701938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.705900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.706645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-32437c73-9586-4499-86c5-07fc804de402 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.231917 Jul 28 17:46:56.707588 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 151/303] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:56 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:56.712881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c1111ecd-3cb5-454a-b5a8-f19cb02ce198 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1469 microversion: 2.1 time: 0.232634 Jul 28 17:46:56.713487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 153/304] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:56 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:56.793675 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:56.794587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:56.803249 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.804194 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.805533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:56.806133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:56.879185 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=12 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.973677 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.982108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.985734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:56.985734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cc6c67e0-e46b-43ae-9c28-5034de2eba17 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.196312 Jul 28 17:46:56.986661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 152/305] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:46:56 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:46:57.490116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-8d291a46-b311-4e76-8273-39aaae730988 req-89b68e4d-e29a-4de0-ba08-e36969d8e434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "name": "network-vif-plugged", "status": "completed", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:57.496615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=8 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:57.507254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-8d291a46-b311-4e76-8273-39aaae730988 req-89b68e4d-e29a-4de0-ba08-e36969d8e434 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:57.507822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-8d291a46-b311-4e76-8273-39aaae730988 req-89b68e4d-e29a-4de0-ba08-e36969d8e434 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:57.524541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-8d291a46-b311-4e76-8273-39aaae730988 req-89b68e4d-e29a-4de0-ba08-e36969d8e434 service nova] Creating event network-vif-plugged:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:46:57.530633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-8d291a46-b311-4e76-8273-39aaae730988 req-89b68e4d-e29a-4de0-ba08-e36969d8e434 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046082 Jul 28 17:46:57.532392 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 154/306] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:46:57.728005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:57.729381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:57.738040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:57.738499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:57.739273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:57.739697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:57.745215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:57.746179 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:57.758050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:57.758716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:57.759806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:57.760751 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:57.907615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:57.915153 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-43d74840-379c-46d1-ab99-071c195971a8 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.190939 Jul 28 17:46:57.916026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 153/307] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:57 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:57.920393 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:57.928814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3127218d-9b6e-45bd-8dc6-b15c188060c7 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1469 microversion: 2.1 time: 0.188869 Jul 28 17:46:57.933602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 155/308] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:57 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1469 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:58.008851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:58.009622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:58.016788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.017378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.018202 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.018630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.168524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:58.177941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:58.179458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:58.180615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-110286ef-d835-476d-bbd1-53849d8f6909 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.175641 Jul 28 17:46:58.181252 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 154/309] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:46:58 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:46:58.939316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:58.941005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:58.949737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:58.950332 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:58.962438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.964181 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.965335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.965798 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.966052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.966573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.968258 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:58.968776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:58.978784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.101863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:59.132529 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ebc2735a-2bef-45ab-ac21-a7b8c441c5b3 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1427 microversion: 2.1 time: 0.186611 Jul 28 17:46:59.133113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 155/310] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:58 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:59.200355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:59.208801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:46:59.209445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:46:59.214939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-11f66492-f688-4abb-9c21-65e9efef6804 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.281266 Jul 28 17:46:59.215846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:59.216150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 156/311] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:46:58 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:59.216642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:59.218159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:59.218947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:59.281621 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-673037b9-5fae-4877-b64e-803d5c00615d req-7a0f7139-eabf-4953-965c-0f0e8ed6fd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6", "name": "network-vif-deleted", "tag": "40c84c19-960a-4aca-8c08-e0f50f24a49c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:46:59.293777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-673037b9-5fae-4877-b64e-803d5c00615d req-7a0f7139-eabf-4953-965c-0f0e8ed6fd82 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:46:59.294441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-673037b9-5fae-4877-b64e-803d5c00615d req-7a0f7139-eabf-4953-965c-0f0e8ed6fd82 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:46:59.325355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-673037b9-5fae-4877-b64e-803d5c00615d req-7a0f7139-eabf-4953-965c-0f0e8ed6fd82 service nova] Creating event network-vif-deleted:40c84c19-960a-4aca-8c08-e0f50f24a49c for instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 on hv-cinder-81322 Jul 28 17:46:59.331965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-673037b9-5fae-4877-b64e-803d5c00615d req-7a0f7139-eabf-4953-965c-0f0e8ed6fd82 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057918 Jul 28 17:46:59.332630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 157/312] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:46:59.388921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:59.397371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:59.398863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:46:59.400009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ff8c62bd-9e22-44d0-a776-aacf8a3991b9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.195235 Jul 28 17:46:59.400558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 156/313] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:46:59 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:00.161549 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:00.162239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:00.168447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.168894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.169690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.170122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.201537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.202743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.202743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lazy-loading 'fault' on Instance uuid 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:47:00.241240 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:00.242055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:00.249863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.250461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.251347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.251900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.252288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902d3de9354b4eefb3d99b6e91432c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83427bbf87f4dbe9e3533033c075c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:00.260306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f8434471-7885-4819-be07-c3246e441390 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 200 len: 1304 microversion: 2.1 time: 0.103379 Jul 28 17:47:00.260879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 158/314] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:00 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:00.402189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:00.411489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7592195b-8962-4ffb-b23d-cfeebc712d06 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1369 microversion: 2.1 time: 0.174192 Jul 28 17:47:00.412055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 157/315] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:00 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:00.423147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:00.423752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:00.433370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.433370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.433370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:00.433370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:00.624043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:00.632864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:00.634425 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:00.635593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e88c3cb9-7606-4366-aa39-5e9c10b3f60b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.216761 Jul 28 17:47:00.636151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 159/316] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:00 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:01.283112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:01.283791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] [instance: 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:01.290162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.290703 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.291523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.291957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.307246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] HTTP exception thrown: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Request method failure captured: Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 HTTP/1.1 Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4st_P5fo_mU5JAn2F1KCfy54SAuDcBXem7oLBlcufIxugkTEuumjtgFvOJZQ_VsJZUc7kmS3FgomMtJsbVFMSxxfpdezy34jXVjo35STcunGbyBwcST7s0uhtvUlw3cnwABDlJyD9jW04X5tXzjimckv4fiFPD1r31G2ZNm5umvYx6g Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: a83427bbf87f4dbe9e3533033c075c9e Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesNegativeTest-2130776996 Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:47:01.308902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/a83427bbf87f4dbe9e3533033c075c9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_a83427bbf87f4dbe9e3533033c075c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/a83427bbf87f4dbe9e3533033c075c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/a83427bbf87f4dbe9e3533033c075c9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesNegativeTest-2130776996 Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: a83427bbf87f4dbe9e3533033c075c9e Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesNegativeTest-2130776996 Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesNegativeTest-2130776996-project Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 902d3de9354b4eefb3d99b6e91432c74 Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesNegativeTest-2130776996-project Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. Jul 28 17:47:01.310462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6'} Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:47:01.311885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. Jul 28 17:47:01.313835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:47:01.315098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] Returning 404 to user: Instance 9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:47:01.315098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c16b0ec5-e857-4c4f-9001-b800474f98f0 tempest-VolumesNegativeTest-2130776996 tempest-VolumesNegativeTest-2130776996-project] 10.222.0.89 "GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6" status: 404 len: 111 microversion: 2.1 time: 0.031490 Jul 28 17:47:01.316663 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 158/317] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:01 2022] GET /compute/v2.1/servers/9a3d01e3-ad7c-4399-83b8-570ea4ac3ae6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:47:01.432783 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:01.433730 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:01.446367 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.446818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.447608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.448377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.595261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:01.603330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-324e9369-0b33-49af-9198-9e45f6224ae5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1562 microversion: 2.1 time: 0.174293 Jul 28 17:47:01.603960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 160/318] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:01 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:01.625358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:01.626186 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:01.633220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.633758 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.634596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.635116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.660021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:01.661133 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:01.672794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.673754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.675004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:01.675604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:01.724983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-060ef55b-8a1b-4bf4-a59a-fe13e46fe83e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104723 Jul 28 17:47:01.725712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 159/319] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:47:01 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:47:01.850744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:01.859505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:01.862545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:01.864062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9b918650-02eb-44c7-aa5d-92680659f053 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.208794 Jul 28 17:47:01.864825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 161/320] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:01 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:02.888938 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:02.904207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:02.924506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:02.924976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:02.928572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:02.929039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:02.934036 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-5cc5d05e-b42f-459e-b550-24a01f40ee7e req-b15babc0-4d3b-4c5c-85a2-73217818f565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:02.949421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5cc5d05e-b42f-459e-b550-24a01f40ee7e req-b15babc0-4d3b-4c5c-85a2-73217818f565 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:02.950014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5cc5d05e-b42f-459e-b550-24a01f40ee7e req-b15babc0-4d3b-4c5c-85a2-73217818f565 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:02.964948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-5cc5d05e-b42f-459e-b550-24a01f40ee7e req-b15babc0-4d3b-4c5c-85a2-73217818f565 service nova] Creating event network-changed:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:47:02.971570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-5cc5d05e-b42f-459e-b550-24a01f40ee7e req-b15babc0-4d3b-4c5c-85a2-73217818f565 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041375 Jul 28 17:47:02.973215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 162/321] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:47:03.153070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:03.164300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:03.165895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:03.167094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-96044694-020a-4d50-80ed-4ccb7b56aa43 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.283468 Jul 28 17:47:03.181736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 160/322] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:02 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:03.534727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-44206fb3-b2c6-4acd-9672-1bedca584be9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:03.542668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44206fb3-b2c6-4acd-9672-1bedca584be9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:03.543453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44206fb3-b2c6-4acd-9672-1bedca584be9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:03.727445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-44206fb3-b2c6-4acd-9672-1bedca584be9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Going to try to stop instance {{(pid=124515) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 17:47:03.805936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-44206fb3-b2c6-4acd-9672-1bedca584be9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action" status: 202 len: 0 microversion: 2.1 time: 0.280581 Jul 28 17:47:03.810598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 163/323] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:47:03 2022] POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:47:03.819074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:03.819958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:03.833721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:03.834712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:03.836501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:03.837231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:04.107866 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:04.118141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b9bdbaec-a1c9-4c5b-8b41-09851aa7072c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.303409 Jul 28 17:47:04.122374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 161/324] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:03 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:04.192785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:04.193518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:04.197067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.208247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:04.208692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:04.209500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:04.209945 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:04.473522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:04.486770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:04.488288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:04.489498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-258faa93-5d10-41a8-bc2d-eac6a80a8488 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.300887 Jul 28 17:47:04.495494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 164/325] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:04 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:05.145362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:05.146119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:05.153263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:05.153790 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:05.154638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:05.155407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:05.319738 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:05.333414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5168dc97-dc43-41b9-a1c0-de4f0c2e3042 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.195600 Jul 28 17:47:05.334107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 162/326] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:05 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:05.513815 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:05.515286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:05.522143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:05.522713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:05.523483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:05.523997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:05.707204 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:05.721093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:05.722726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:05.724208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-87f7ba81-774e-4dfa-a66d-c4726cb53aa7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.214633 Jul 28 17:47:05.726763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 165/327] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:05 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:06.354793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:06.355366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:06.357750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:06.363960 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:06.364404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:06.365177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:06.365614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:06.500609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:06.508438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-35903e22-7126-4966-8570-3bf84643df4e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.157570 Jul 28 17:47:06.509002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 163/328] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:06 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:06.755742 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:06.756376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:06.763085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:06.763533 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:06.764287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:06.765281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:06.912754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:06.921150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:06.922718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:06.923873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-39a494a6-abcc-4f46-8218-cf4db78f2fdb tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.171993 Jul 28 17:47:06.924423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 166/329] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:06 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:07.531015 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:07.531743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:07.538325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:07.538774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:07.539958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:07.540435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:07.692211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:07.701575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-044d3c5b-06d3-437d-ac8e-bb637d60cefc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.173329 Jul 28 17:47:07.701575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 164/330] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:07 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:07.947335 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:07.947932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:07.954822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:07.955190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:07.955947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:07.956371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:08.100995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:08.109772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:08.111525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:08.112773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ae54e23c-df57-4485-9429-1e028b6b7008 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.169310 Jul 28 17:47:08.113363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 167/331] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:07 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:08.722977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:08.723535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:08.730381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:08.730824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:08.731594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:08.732023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:08.875701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:08.883674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-522c3ac6-8e8a-4a95-9509-9e0211bb0826 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.165868 Jul 28 17:47:08.884243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 165/332] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:08 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:09.136516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:09.137289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:09.144587 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:09.145272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:09.146562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:09.147085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:09.494798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:09.505634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:09.507059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:09.508401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5a587a6f-5473-413e-a92d-79d2e112e257 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.376146 Jul 28 17:47:09.509136 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 168/333] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:09 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:09.908130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:09.908600 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:09.933076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:09.933807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:09.935480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:09.936086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:10.135812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:10.145117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fc09c0f5-6b35-4163-861c-f9ee17fbce10 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.242482 Jul 28 17:47:10.146014 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 166/334] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:09 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:10.533535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:10.534562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:10.541978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:10.542636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:10.543632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:10.544162 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:10.549020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.724263 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:10.732380 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:10.734437 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:10.735412 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8e5cb577-d14d-4646-af1c-2141b427799b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.207453 Jul 28 17:47:10.736138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 169/335] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:10 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:11.167524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:11.168788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:11.177454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:11.178124 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:11.179080 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:11.179508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:11.423451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:11.431656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-98f0f4bb-5697-4036-a5fc-c4caada98c07 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.267863 Jul 28 17:47:11.432485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 167/336] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:11 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:11.759727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:11.761070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:11.793733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:11.794415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:11.795408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:11.797067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:12.033107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:12.043355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:12.045421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:12.046870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-96d08026-852d-411f-8b2b-8379d896218f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.291226 Jul 28 17:47:12.048308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 170/337] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:11 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:12.454463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:12.459570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:12.466530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:12.467216 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:12.468696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:12.469331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:12.713745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:12.722834 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bc305864-8501-4712-90c7-e45c61d8b489 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.272800 Jul 28 17:47:12.723842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 168/338] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:12 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:13.071953 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:13.075778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:13.084719 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:13.085363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:13.086511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:13.087037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:13.260685 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:13.269904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:13.271803 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:13.273461 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-278dabfd-258b-4dca-8a7f-dc5c4d999160 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.205494 Jul 28 17:47:13.274336 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 171/339] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:13 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:13.750816 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:13.751650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:13.761424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:13.762201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:13.763291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:13.763805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:14.020110 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:14.030710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c8bd4d6d-1403-4967-8102-a7cd9ab35d87 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.288449 Jul 28 17:47:14.031710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 169/340] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:13 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:14.303620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:14.304250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:14.329690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:14.330427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:14.343993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:14.344729 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:14.510801 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:14.520385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:14.522325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:14.523488 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a4ba2852-12c1-4d3a-9582-f2d25ba2e79c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.230259 Jul 28 17:47:14.524220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 172/341] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:14 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:15.052734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:15.056164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:15.068359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:15.069980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:15.071087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:15.071539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:15.551864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:15.552702 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:15.561058 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:15.565981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:15.567235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:15.568135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:15.721510 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:15.735203 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-52d6dd98-dbab-4676-982b-4bdd6f947ad9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.686075 Jul 28 17:47:15.735824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 170/342] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:15 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:15.799781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:15.813075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:15.814903 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:15.817357 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cd68900c-a911-43ab-a2cd-58a5244f1c7c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1746 microversion: 2.20 time: 0.268809 Jul 28 17:47:15.818514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 173/343] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:15 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1746 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:16.757984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:16.759348 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:16.767759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:16.768567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:16.769608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:16.770293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:16.851135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:16.855948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:16.884558 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:16.888617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:16.889828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:16.890291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:17.096776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:17.107969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-301688db-44fd-443a-984b-c6b93cd47e46 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.353735 Jul 28 17:47:17.125430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 171/344] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:16 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:17.350029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:17.363509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:17.367321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:17.368869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2e0dbcfe-a28e-4aad-a56d-c8aab8089494 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1746 microversion: 2.20 time: 0.525785 Jul 28 17:47:17.370967 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 174/345] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:16 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1746 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:18.005891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-666b8656-4e19-4d5e-8ab9-13423ec8104a req-426d6e7f-6df9-4683-b204-58337781767c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "name": "network-vif-plugged", "status": "completed", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:18.031403 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-666b8656-4e19-4d5e-8ab9-13423ec8104a req-426d6e7f-6df9-4683-b204-58337781767c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:18.032944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-666b8656-4e19-4d5e-8ab9-13423ec8104a req-426d6e7f-6df9-4683-b204-58337781767c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:18.057992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-666b8656-4e19-4d5e-8ab9-13423ec8104a req-426d6e7f-6df9-4683-b204-58337781767c service nova] Creating event network-vif-plugged:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:47:18.064913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-666b8656-4e19-4d5e-8ab9-13423ec8104a req-426d6e7f-6df9-4683-b204-58337781767c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069078 Jul 28 17:47:18.066286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 172/346] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:47:18.131776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:18.132565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:18.142616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:18.143376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:18.144343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:18.144966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:18.382158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:18.393653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:18.394659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:18.397111 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f3cfc635-4714-4d4b-9849-ad40aaf1e311 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.270144 Jul 28 17:47:18.397728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 175/347] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:18 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:18.402028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:18.403272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:18.404295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:18.405482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:18.426275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:18.559373 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:18.570144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:18.572055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:18.573643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3216a604-ce00-4007-a5a3-75c9236edac3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1746 microversion: 2.20 time: 0.184148 Jul 28 17:47:18.574567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 173/348] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:18 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1746 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:19.421436 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:19.422812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:19.430726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:19.431218 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:19.431943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:19.432378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:19.608874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:19.609495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:19.610678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:19.618747 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-513cfeb8-aa45-4573-9d1f-93b487e5f251 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.202233 Jul 28 17:47:19.619350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 176/349] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:19 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:19.621114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:19.621620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:19.622983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:19.623587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:19.854388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:19.864175 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:19.865994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:19.870189 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8a22d8b6-17e4-4ae6-be41-9e084435405a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.271065 Jul 28 17:47:19.871429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 174/350] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:19 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:20.640705 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:20.641384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:20.648173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:20.648852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:20.649975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:20.650557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:20.887564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:20.899087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6256c526-a8bf-4418-8240-d04d80434227 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.262814 Jul 28 17:47:20.899656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:20.900375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:20.901196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 177/351] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:20 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:20.910688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:20.911469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:20.913333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:20.917360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:21.151162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:21.160958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:21.162517 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:21.163691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-63568c6a-f4e8-4f34-9161-9e6d180a8709 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.267972 Jul 28 17:47:21.164247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 175/352] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:20 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:21.923640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:21.924253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:21.940884 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:21.941384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:21.947845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:21.948612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:22.169534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:22.179604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-91862c94-f3dd-480c-b273-f3ef3983f04b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.261249 Jul 28 17:47:22.180403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 178/353] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:21 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:22.198128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:22.198750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:22.207619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:22.208407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:22.209498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:22.210128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:22.502263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:22.516470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:22.527976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:22.529599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-453bdbc6-4054-49ce-85ad-36366ebd5516 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.337446 Jul 28 17:47:22.531018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 176/354] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:22 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:23.201550 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:23.203509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:23.215278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:23.216664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:23.219545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:23.220944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:23.471846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:23.481523 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-491671e9-10f9-4438-924d-16abc1ae842a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.284984 Jul 28 17:47:23.485787 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 179/355] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:23 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:23.554940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:23.555551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:23.571804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:23.586135 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:23.592098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:23.594147 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:23.887330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:23.922334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:23.926164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:23.931054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2b7743fe-4733-4aa7-b5e4-b926cac6f246 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.379984 Jul 28 17:47:23.943101 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 177/356] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:23 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:24.511009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:24.512071 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:24.527626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:24.531232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:24.537936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:24.541528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:24.846669 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:24.863515 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-536a98cf-f0ac-46d7-888c-d075b1e7ae65 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1722 microversion: 2.1 time: 0.356635 Jul 28 17:47:24.864578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 180/357] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:24 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:24.960176 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:24.961734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:24.986039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:24.987399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:24.988784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:24.989655 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:25.246123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:25.267994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:25.271646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:25.275001 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-97b1b2e0-21f0-4b57-8719-07379ad1e3f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.320013 Jul 28 17:47:25.279146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 178/358] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:24 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:25.905555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:25.907298 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:25.932805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:25.933746 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:25.936863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:25.944281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.304726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:26.309191 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:26.317298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:26.318030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.319635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:26.320273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.341037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:26.356711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5bd0e6af-f7af-4538-be89-e9deb1270c39 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1699 microversion: 2.1 time: 0.473247 Jul 28 17:47:26.357444 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 181/359] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:25 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1699 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:26.379340 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71c8f2c2-ad9e-46e1-bb31-c0fafd7a5543 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:26.390433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71c8f2c2-ad9e-46e1-bb31-c0fafd7a5543 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:26.392168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71c8f2c2-ad9e-46e1-bb31-c0fafd7a5543 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.446847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-71c8f2c2-ad9e-46e1-bb31-c0fafd7a5543 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Going to try to start instance {{(pid=124515) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 17:47:26.562589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-71c8f2c2-ad9e-46e1-bb31-c0fafd7a5543 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action" status: 202 len: 0 microversion: 2.1 time: 0.188135 Jul 28 17:47:26.563878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 182/360] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:47:26 2022] POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:47:26.586522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:26.587414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:26.600930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:26.601855 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.602718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:26.603296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:26.803350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:26.815604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:26.817736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:26.819186 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f3d6ac83-4d46-49f5-835c-aa36e0e17464 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.521565 Jul 28 17:47:26.819980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 179/361] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:26 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:27.581095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:27.608009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ddfd955e-e7ca-49f7-952b-421fd28b6c36 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1708 microversion: 2.1 time: 1.037530 Jul 28 17:47:27.617145 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 183/362] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:26 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1708 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:27.856550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:27.857068 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:27.878464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:27.878914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:27.894846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:27.897764 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:28.403743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:28.424130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:28.427529 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:28.429790 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-49bd0bcb-cda4-4597-af8e-f4ea43698cde tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.584435 Jul 28 17:47:28.447188 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 180/363] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:27 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:28.640521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:28.641086 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:28.656825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:28.657299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:28.658092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:28.658528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:29.396408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:29.399807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:29.409743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-219ee381-10d0-46e0-a07c-3af269239c84 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1708 microversion: 2.1 time: 0.772249 Jul 28 17:47:29.413209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 184/364] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:28 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1708 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:29.456270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:29.457613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:29.469865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:29.478957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:29.480064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:29.483979 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:29.796443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:29.809362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:29.811246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:29.812638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7d1542dc-b50f-4e5d-ba82-e1f6b5c9439b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.360735 Jul 28 17:47:29.826099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 181/365] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:29 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:30.434645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:30.435315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:30.466986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:30.467430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:30.468240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:30.468822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:30.837251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:30.838352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:30.848615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:30.849055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:30.849857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:30.850289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:30.923582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:30.931651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fc7bcae9-88a4-4fb0-8b52-fef043261b42 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1712 microversion: 2.1 time: 0.500978 Jul 28 17:47:30.944080 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 185/366] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:30 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1712 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:31.247689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:31.256556 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:31.262499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:31.271400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-41811ecd-100b-469e-8bf3-14eb73686250 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.437914 Jul 28 17:47:31.272109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 182/367] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:30 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:32.303035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:32.304411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:32.328520 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:32.333708 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:32.335947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:32.340746 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:32.673388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:32.687942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:32.693922 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:32.695714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a5d48d42-94f9-4311-ba02-5ee64a79e164 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.401336 Jul 28 17:47:32.711210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 186/368] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:32 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:33.748035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:33.748544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:33.763942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:33.764900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:33.774604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:33.775257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:34.173355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:34.184546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:34.187003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:34.189012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-98709b81-bfda-4125-a32b-5ba02fbc32dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.456109 Jul 28 17:47:34.190507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 183/369] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:33 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:34.790948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-99edabd0-74ec-49c6-a1b1-2c4b73cbd5b4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'create', calling method: .version_select at 0x7fce3a07ae50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-774897156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEAtkE8pJGH+LjADUkHbBUH6lL03DPffsT3yazMg+cnnxB8eoMFBeXnoHfEaN7Nqdb2d6XKruc0yMparCCAHw4Jg3g346FmX1sGQpYLaUYmiaZINk7/BCcA9LkBWkyo6w=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:34.807179 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=46 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.837821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-99edabd0-74ec-49c6-a1b1-2c4b73cbd5b4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Getting quotas for project 0513cb18c0cd43d5a4784f573bb382d4. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:47:34.845066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-99edabd0-74ec-49c6-a1b1-2c4b73cbd5b4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Getting quotas for user ccc41bad96884148a0088cc8048a2316 and project 0513cb18c0cd43d5a4784f573bb382d4. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:47:34.957723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-99edabd0-74ec-49c6-a1b1-2c4b73cbd5b4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.170659 Jul 28 17:47:34.959147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 187/370] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:47:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:47:35.105727 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1476685388", "imageRef": "2b22e4d3-bc08-4924-a7d9-44aa859331c2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-774897156", "networks": [{"uuid": "9bb61a2e-af39-4830-a017-e8c560155c59"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:35.186419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] validate_networks() for [('9bb61a2e-af39-4830-a017-e8c560155c59', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:47:35.215805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:35.216402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:35.227148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:35.228228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:35.229445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:35.230037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:35.463076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:35.477940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:35.479833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:35.482931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bbc15ad1-1e5a-4bc4-8ca9-7d2b47bc9b96 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.270985 Jul 28 17:47:35.485796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 188/371] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:35 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:35.780973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:47:35.781883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:47:35.782997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:47:35.782997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:47:35.783224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:47:35.799698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:35.800416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:35.801849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:35.802528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:35.825100 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Getting quotas for project 0513cb18c0cd43d5a4784f573bb382d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:47:35.831629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Getting quotas for user ccc41bad96884148a0088cc8048a2316 and project 0513cb18c0cd43d5a4784f573bb382d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:47:35.850995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:47:35.853722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b22e4d3-bc08-4924-a7d9-44aa859331c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:47:35.958760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-68b1289b-6c7b-4daf-b42f-f11a24079e2b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856753 Jul 28 17:47:35.961464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 184/372] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:47:35.971122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ec86c0e3-9df5-4e4b-8bc5-891e5a700aaa tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:35.971741 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ec86c0e3-9df5-4e4b-8bc5-891e5a700aaa tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:36.097584 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ec86c0e3-9df5-4e4b-8bc5-891e5a700aaa tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:36.108911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ec86c0e3-9df5-4e4b-8bc5-891e5a700aaa tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1258 microversion: 2.1 time: 0.141612 Jul 28 17:47:36.111818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 189/373] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:35 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:36.511157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:36.511979 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:36.530427 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.532789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:36.535099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:36.537997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:36.538802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:36.848804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:36.878998 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:36.880850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:36.882099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c01c3f3e-d126-49a0-b63a-785d9654ee47 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.376216 Jul 28 17:47:36.887450 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 185/374] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:36 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:37.133116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:37.134368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:37.151608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:37.152985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:37.154486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:37.155609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:37.262672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:37.277149 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c8b4d99c-c9f8-4ede-b7e1-e4c978273aa6 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1254 microversion: 2.1 time: 0.149123 Jul 28 17:47:37.278648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 190/375] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:37 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1254 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:37.912366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:37.913813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:37.926900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:37.927689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:37.928682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:37.933970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:38.282808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:38.299966 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:38.302263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:38.302698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:38.303308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:38.306814 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5bb3b70c-23cc-4ba1-8f6b-2c45d5fa3743 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.398901 Jul 28 17:47:38.309939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 186/376] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:37 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:38.314062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:38.314510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:38.315280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:38.315714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:38.446414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:38.455888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-26cc0bbb-0dd3-4eef-b239-911877856a7b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1310 microversion: 2.1 time: 0.156970 Jul 28 17:47:38.460762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 191/377] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:38 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1310 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:39.351010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:39.352836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:39.367107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:39.368187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:39.370385 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:39.371482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:39.490178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:39.491215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:39.510193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:39.512947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:39.518132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:39.522013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:39.749115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:39.757927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-91133d35-d0d0-4c0e-958b-5b116dda8ea7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1316 microversion: 2.1 time: 0.273004 Jul 28 17:47:39.762198 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 192/378] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:39 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:39.958066 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:39.966564 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:39.968177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:39.969571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-81bb280f-e5f1-4928-82a1-27b4f5d6387d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.633252 Jul 28 17:47:39.982566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 187/379] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:39 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:40.791821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:40.793354 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:40.821611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:40.824369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:40.828506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:40.830565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:40.996165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:40.997539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:41.010671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:41.020357 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:41.024323 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:41.025538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:41.693896 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:41.717738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6433a3ce-1fbb-44eb-9ad0-d75d01d764e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.931174 Jul 28 17:47:41.718832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 193/380] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:40 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:41.851464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:41.869950 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:41.884211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:41.892230 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-142940fc-46a2-45ea-b73f-e8c8eb062737 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.899494 Jul 28 17:47:41.894278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 188/381] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:40 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:42.742094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:42.742662 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:42.759909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:42.760361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:42.761187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:42.761602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:42.922475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:42.924814 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:42.954023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:42.955037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:42.956079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:42.956696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:43.252311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:43.275559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e524d089-4474-45ef-a1f7-1548bd44bb7f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.537273 Jul 28 17:47:43.289302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 194/382] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:42 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:43.353370 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:43.372963 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:43.375426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:43.376656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9f300068-d79d-4acc-9776-762880c8dff2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.458941 Jul 28 17:47:43.387658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 189/383] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:42 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:43.765187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-3b74bced-f5c7-4f62-a100-9d0dd30361b7 req-e5a8dbd0-1875-4575-833a-8afc2dff3c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:43.806216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-3b74bced-f5c7-4f62-a100-9d0dd30361b7 req-e5a8dbd0-1875-4575-833a-8afc2dff3c61 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:43.806905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-3b74bced-f5c7-4f62-a100-9d0dd30361b7 req-e5a8dbd0-1875-4575-833a-8afc2dff3c61 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:43.834321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-3b74bced-f5c7-4f62-a100-9d0dd30361b7 req-e5a8dbd0-1875-4575-833a-8afc2dff3c61 service nova] Creating event network-changed:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:47:43.844926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-3b74bced-f5c7-4f62-a100-9d0dd30361b7 req-e5a8dbd0-1875-4575-833a-8afc2dff3c61 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084112 Jul 28 17:47:43.847990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 195/384] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:47:44.300904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:44.301531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:44.315547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:44.315997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:44.317018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:44.317554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:44.420622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:44.422409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:44.433105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:44.433860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:44.434866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:44.435460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:44.480789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:44.483000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.490747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c8956359-9b1b-4781-9b01-810a0cbe086c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.197883 Jul 28 17:47:44.491340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 190/385] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:44 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:44.663782 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:44.676288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:44.678319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:44.680235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b93b705d-8e23-4a34-a31a-8867e78b8c2d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.264799 Jul 28 17:47:44.686016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 196/386] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:44 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:45.514111 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:45.529700 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:45.541337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:45.545859 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:45.547232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:45.547773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:45.648426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d3d24a17-c84a-41d3-a2ec-45f3aa29c43f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Action: 'create', calling method: .version_select at 0x7fce3a9145e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-552830010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx53UJFFvJMR0R3m8ZlNomKdit0vVvYas6eZMC19TZfTe63gcheeywOorClqcrmKdbs1jSW76eU33VKGXBYhfaVra/ub9pa5pU9g8LeAQzUSSJuqBATGTlSpk7Q1BNTpg=="}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:45.680710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-d3d24a17-c84a-41d3-a2ec-45f3aa29c43f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Getting quotas for project 0ef795b478944722886f1d084f49008d. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:47:45.684977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-d3d24a17-c84a-41d3-a2ec-45f3aa29c43f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Getting quotas for user 1cd17607cef54135a91f39ccd74b6180 and project 0ef795b478944722886f1d084f49008d. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:47:45.740363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d3d24a17-c84a-41d3-a2ec-45f3aa29c43f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.374006 Jul 28 17:47:45.747696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 191/387] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:47:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:47:45.748365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:45.750192 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:45.754142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:45.762660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2932f268-a394-43ff-b730-5c34d270aea4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.252800 Jul 28 17:47:45.762811 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:45.763244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 197/388] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:45 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:45.763551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:45.764686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:45.765333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:45.817860 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:46.156606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:46.166589 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:46.168324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:46.169481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-38d4afcf-a460-4e85-aa82-1a436f6d8eff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.425873 Jul 28 17:47:46.170043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 192/389] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:45 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:46.784780 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:46.789003 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:46.798506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=6 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:46.801386 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:46.801849 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:46.802678 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:46.803404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:47.131649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:47.155717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a2ff0ae9-2d64-467f-876e-c6b2d7952c72 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.374443 Jul 28 17:47:47.160351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 198/390] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:46 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:47.199404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:47.201119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:47.213352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:47.213846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:47.214650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:47.215090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:47.492751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:47.512806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:47.514897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:47.534050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fa555cb2-97be-4879-a84c-bd617c05b18e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.332254 Jul 28 17:47:47.534826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 193/391] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:47 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:48.180553 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:48.181207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:48.198370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:48.205454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:48.210159 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:48.210781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:48.496343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:48.510424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-407574ad-2ee2-46e2-84fb-b42f2246966f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.333645 Jul 28 17:47:48.511894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 199/392] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:48 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:48.577763 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:48.579709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:48.587990 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:48.588879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:48.589968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:48.590616 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:48.790253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:48.806076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:48.820379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:48.821863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-19e1a2e2-5de1-44b1-858d-8bde34fc373f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.249605 Jul 28 17:47:48.822903 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 194/393] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:48 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:49.535118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:49.536467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:49.547502 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:49.549136 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:49.550304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:49.551840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:49.829269 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:49.855257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:49.855909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:49.863961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:49.865758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-66032a81-8a2d-4293-9d96-1fafdfa767b0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.336077 Jul 28 17:47:49.866639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 200/394] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:49 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:49.867075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:49.868136 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:49.869109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:50.187336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:50.199350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:50.200885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:50.202936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d18dd8b6-11a4-4075-8c54-eeb2ec3d816d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.351651 Jul 28 17:47:50.203711 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 195/395] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:49 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:50.888228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:50.888846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:50.897240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:50.897865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:50.898832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:50.899484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:51.038939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:51.047122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-91910f33-5232-4a4c-afb2-db985d01b034 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.162711 Jul 28 17:47:51.047889 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 201/396] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:50 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:51.226413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:51.227036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:51.234251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:51.234700 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:51.235469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:51.235906 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:51.384196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:51.392630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:51.394193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:51.395384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-879c840a-f341-49c0-a35e-92d837743ebf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.172952 Jul 28 17:47:51.395945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 196/397] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:51 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:52.068200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:52.068748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:52.076261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:52.076718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:52.078253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:52.078695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:52.228792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:52.244786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7d254164-8857-4ab9-a8be-b4153c2f451b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.180422 Jul 28 17:47:52.245559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 202/398] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:52 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:52.419330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:52.419928 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:52.426688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:52.427137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:52.427905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:52.428339 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:52.571858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:52.581037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:52.582996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:52.584287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fd30a257-9d6b-4da2-beb1-36769dbcde24 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.169008 Jul 28 17:47:52.585059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 197/399] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:52 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:53.267203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:53.267772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:53.274604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:53.275051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:53.275807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:53.276239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:53.417271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:53.424934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-41b060f2-96ff-4f93-b13f-f7969fa7ffb3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.162680 Jul 28 17:47:53.425544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 203/400] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:53 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:53.608604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:53.609402 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:53.619730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:53.620355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:53.621139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:53.621608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:53.762150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:53.771602 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:53.773089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:53.774265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-239b4fa2-9e30-48d5-aecb-77305edc574c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1741 microversion: 2.20 time: 0.169641 Jul 28 17:47:53.774821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 198/401] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:53 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:47:54.446441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:54.447048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:54.453915 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:54.454359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:54.455129 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:54.455564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:54.459902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.597250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:54.605483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2cd3c093-bbfb-4fae-85d8-0f85bc3b06ae tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.162794 Jul 28 17:47:54.606056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 204/402] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:54 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:54.797352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:54.797967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:54.804699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:54.805146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:54.805937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:54.806370 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:55.132429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:55.141383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:55.142902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:55.144662 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3d6141e7-c8df-4509-8a10-59ccbde9ac7a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1723 microversion: 2.20 time: 0.351023 Jul 28 17:47:55.145253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 199/403] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:54 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:55.630127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:55.630695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:55.637640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:55.638360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:55.638846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:55.640091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:55.785687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:55.793149 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e8ce3e00-c4bd-4282-819e-8f6f4837518f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.168692 Jul 28 17:47:55.793748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 205/404] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:55 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:56.169567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:56.170120 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:56.172394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=10 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.178645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:56.179092 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:56.179843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:56.180270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:56.326621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:56.335900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:56.337454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:56.338615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-785099a4-df82-44d3-9175-baac80cd00a9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1723 microversion: 2.20 time: 0.173314 Jul 28 17:47:56.339171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 200/405] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:56 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:56.814806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:56.815331 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:56.821981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:56.822433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:56.823210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:56.823647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:56.961678 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:56.970193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1de8e4cc-88d1-4218-9599-67b27b31d280 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.159594 Jul 28 17:47:56.970917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 206/406] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:56 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:57.364266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:57.364800 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:57.371199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:57.371641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:57.372395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:57.372821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:57.506987 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:57.516097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:57.517681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:57.518854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f846a515-2c17-4f73-8d83-772ba81b38d8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1723 microversion: 2.20 time: 0.158574 Jul 28 17:47:57.519416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 201/407] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:57 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:57.992263 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:57.992866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:58.000402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:58.000847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:58.001628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:58.002083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:58.135607 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:58.144404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e80266be-2afe-4a2a-8c57-ed15801869bc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.155963 Jul 28 17:47:58.144966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 207/408] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:57 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:58.541473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:58.542269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:58.549434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:58.549883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:58.550650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:58.551085 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:58.690820 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:58.698907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:58.700417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:58.701609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-df80b27a-f255-426d-8af4-d154ce841f6f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1723 microversion: 2.20 time: 0.164341 Jul 28 17:47:58.702266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 202/409] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:58 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:59.110819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cf32f5b-1856-4fdf-ae2b-2e3817d873e4"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:59.113247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:59.120099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.120540 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.121328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.121753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.166183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:59.167722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:59.176145 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.176701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.177625 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.178093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.331139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:59.339003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9144d0a2-b46a-457f-a152-189315140e59 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.176801 Jul 28 17:47:59.339577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 203/410] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:47:59 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:59.434024 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-604f2237-e479-4c32-9b5a-b30a75d1114e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328576 Jul 28 17:47:59.436798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 208/411] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:47:59 2022] POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:47:59.726752 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:47:59.727514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:59.734334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.736075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.737065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.737539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.899090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-45cfa8da-8a5c-4d05-925b-5618e2ee7c51 req-499365bb-d6d7-4291-b646-3715577f1a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "name": "network-vif-unplugged", "status": "completed", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:59.918758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-45cfa8da-8a5c-4d05-925b-5618e2ee7c51 req-499365bb-d6d7-4291-b646-3715577f1a9c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.919556 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-45cfa8da-8a5c-4d05-925b-5618e2ee7c51 req-499365bb-d6d7-4291-b646-3715577f1a9c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.934360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.compute.server_external_events [req-45cfa8da-8a5c-4d05-925b-5618e2ee7c51 req-499365bb-d6d7-4291-b646-3715577f1a9c service nova] Unable to find a host for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8. Dropping event network-vif-unplugged {{(pid=124515) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 17:47:59.936004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-45cfa8da-8a5c-4d05-925b-5618e2ee7c51 req-499365bb-d6d7-4291-b646-3715577f1a9c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041730 Jul 28 17:47:59.937195 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 209/412] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 17:47:59.940333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:59.950900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:59.953978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:47:59.955445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-da4b05b7-ad7b-4151-8bba-11e99cd26018 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1666 microversion: 2.20 time: 0.232860 Jul 28 17:47:59.956006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 204/413] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:47:59 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1666 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:47:59.980007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d09d950-1298-4bf2-8382-1887d0bda175"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:47:59.982503 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:47:59.990223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.990716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:47:59.991512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:47:59.991939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.362551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:00.363466 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:00.367351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ad6509d9-6ab9-49d9-8a82-62274248bcf2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391459 Jul 28 17:48:00.368477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 210/414] 10.222.0.89 () {62 vars in 1364 bytes} [Thu Jul 28 17:47:59 2022] POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments => generated 188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:00.378333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.378792 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.379576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.380016 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.506548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:00.507140 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:00.514668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.515061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.515944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.517191 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.553098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:00.563843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-089ccd45-7c59-4229-8755-2abbc8976672 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.207327 Jul 28 17:48:00.565484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 205/415] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:00 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:00.587757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124515) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 17:48:00.677792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-41ceeef9-bb81-4a67-9612-19222131df77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/action" status: 202 len: 0 microversion: 2.20 time: 0.175322 Jul 28 17:48:00.679005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 211/416] 10.222.0.89 () {62 vars in 1319 bytes} [Thu Jul 28 17:48:00 2022] POST /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:00.687905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:00.689007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:00.697416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.699643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.700700 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:00.701484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:00.884872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:00.897462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:00.899014 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:00.900241 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4bd26b4a-0544-45df-afdc-a385753e2707 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1752 microversion: 2.20 time: 0.217296 Jul 28 17:48:00.901508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 206/417] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:00 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:01.595536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:01.596341 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:01.608113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:01.608522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:01.609481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:01.610223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:01.838819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:01.851655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c73ea92e-f18e-4f2d-96c1-9a56a8eb82c2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.265857 Jul 28 17:48:01.852333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 212/418] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:01 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:01.943404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:01.944032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:01.950839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:01.951733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:01.952582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:01.953085 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:01.985766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-3c0c7185-2734-4d3b-baa8-08cb4a8869de req-9c86c2b3-ca4a-477b-8f7c-36e8c7876f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "name": "network-vif-plugged", "status": "completed", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:02.009090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-3c0c7185-2734-4d3b-baa8-08cb4a8869de req-9c86c2b3-ca4a-477b-8f7c-36e8c7876f85 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:02.009816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-3c0c7185-2734-4d3b-baa8-08cb4a8869de req-9c86c2b3-ca4a-477b-8f7c-36e8c7876f85 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:02.040968 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-3c0c7185-2734-4d3b-baa8-08cb4a8869de req-9c86c2b3-ca4a-477b-8f7c-36e8c7876f85 service nova] Creating event network-vif-plugged:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:48:02.049109 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-3c0c7185-2734-4d3b-baa8-08cb4a8869de req-9c86c2b3-ca4a-477b-8f7c-36e8c7876f85 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070639 Jul 28 17:48:02.049933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 213/419] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:48:02.129838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:02.140609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:02.142426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:02.143644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f23fcf92-b8f1-4726-acb4-34e94e275dc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1752 microversion: 2.20 time: 0.204506 Jul 28 17:48:02.144201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 207/420] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:01 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:02.874744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:02.875543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:02.881740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:02.882194 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:02.883006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:02.883443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:03.020631 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:03.029239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dac3b29e-4796-49bf-a6ca-22c12a106158 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1358 microversion: 2.1 time: 0.159188 Jul 28 17:48:03.029825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 214/421] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:02 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:03.171002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:03.171929 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:03.179325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:03.179771 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:03.180548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:03.180982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:03.196288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.315400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:03.324058 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:03.325584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:03.326745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c70e5ecb-32d0-484f-9ecd-f39c48d03f5a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1754 microversion: 2.20 time: 0.159818 Jul 28 17:48:03.327290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 208/422] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:03 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:04.050971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:04.051578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:04.058207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.058652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.059424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.059856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.197990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.205858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-21e7a20c-04dc-4012-a7d5-4eb7023667c5 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1548 microversion: 2.1 time: 0.159441 Jul 28 17:48:04.206427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 215/423] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:04 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:04.226859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:04.227474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:04.234060 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.234514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.236029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.236562 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.365373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:04.366092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:04.378337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.378787 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.379569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.380005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.382398 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.390322 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-63de85c9-d62e-4366-b5b4-69131c7b1a4f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1548 microversion: 2.1 time: 0.167358 Jul 28 17:48:04.391078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 209/424] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:04 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:04.411122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:04.416002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.416863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Searching by: {'deleted': False, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4'} {{(pid=124516) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 17:48:04.424953 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.425521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.426378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.426874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.510496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.518663 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.multi_cell_list [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 17:48:04.520435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.522127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.523315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5c98c4f6-8683-44a4-b46b-72cb3c91ec53 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1754 microversion: 2.20 time: 0.170204 Jul 28 17:48:04.523920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 216/425] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:04 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:04.619338 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a2e172e3-6e03-4630-b8b1-068f5d2f0647 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212682 Jul 28 17:48:04.620146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 210/426] 10.222.0.89 () {58 vars in 1125 bytes} [Thu Jul 28 17:48:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:48:04.632338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:04.633034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:04.639207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.639905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.640651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:04.641211 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:04.645850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.776385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:04.784373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8474ec35-a1c5-47bc-bd53-caa9616ea70b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1548 microversion: 2.1 time: 0.156031 Jul 28 17:48:04.784943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 217/427] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:04 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:05.547405 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:05.548313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:05.554629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:05.555096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:05.555841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:05.556284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:05.690212 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:05.698481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:05.699965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:05.701109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b4df81cd-9b52-431d-bca3-70c094e65c2b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1754 microversion: 2.20 time: 0.157736 Jul 28 17:48:05.701691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 211/428] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:05 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:06.344126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897ba447-c956-4a57-964e-916104e6ca2a"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:06.347225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:06.349734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.355303 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:06.355748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:06.356523 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:06.356956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:06.645760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cbd0abd5-8d22-406c-98cd-cfe3bcba4cc4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305340 Jul 28 17:48:06.646315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 218/429] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:48:06 2022] POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:48:06.725306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:06.726863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:06.729334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.734755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:06.735604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:06.736388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:06.736861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:06.871355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:06.880776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:06.882289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:06.883436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d92f5992-0df3-4436-ac51-d627842260c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1754 microversion: 2.20 time: 0.162992 Jul 28 17:48:06.884026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 212/430] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:06 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:07.118979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:07.121353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:07.128092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.128531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:07.129303 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.129732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:07.152636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lazy-loading 'flavor' on Instance uuid ef3b9253-025e-4a8d-af04-b8951ed85ae8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:48:07.278297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-88bfb6ac-7095-431c-b393-01c149f8ce64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/action" status: 200 len: 32 microversion: 2.1 time: 0.164143 Jul 28 17:48:07.279292 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 219/431] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:48:07 2022] POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:48:07.289236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:07.289864 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:07.296326 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.296836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:07.297898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.298352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:07.518756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:07.528715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c58b3298-316c-426b-b680-ceb8731203b9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.243089 Jul 28 17:48:07.529991 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 213/432] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:07 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:07.908509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:07.909318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:07.915467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.915920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:07.916692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:07.917129 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:08.054142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:08.062570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:08.065087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:08.066275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fbca7450-6259-4ca6-820d-cc9ef46374a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162764 Jul 28 17:48:08.066833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 220/433] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:07 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:08.551566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:08.552592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:08.558958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:08.559404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:08.560260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:08.560678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:08.739741 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:08.748668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a8494580-da7b-4ebe-8fc9-e3914a550acc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.201549 Jul 28 17:48:08.749275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 214/434] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:08 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:09.089936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:09.090592 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:09.097402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:09.097842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:09.098599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:09.099028 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:09.245235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:09.255534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:09.257055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:09.258248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c0156792-3a76-4e98-9632-3325766da099 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.172166 Jul 28 17:48:09.258811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 221/435] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:09 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:09.772315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:09.772803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:09.779387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:09.779841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:09.780720 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:09.781204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:10.039368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:10.049079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-725b4b67-c2c7-41b9-bca1-7ec224056ac4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.279931 Jul 28 17:48:10.050440 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 215/436] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:09 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:10.289967 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:10.290997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:10.300609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:10.301062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:10.301886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:10.302323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:10.484704 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:10.494280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:10.495801 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:10.496972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-44760c2b-1ab0-416f-bec4-3c861700a601 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.217589 Jul 28 17:48:10.497575 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 222/437] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:10 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:10.737342 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1186719233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-552830010", "security_groups": [{"name": "tempest-secgroup-smoke-1616033148"}], "networks": [{"uuid": "3c408952-a8f7-48c3-935f-d12a5087c0dd"}], "block_device_mapping_v2": [{"uuid": "bf4d5627-03ef-4d39-8067-8e3403376675", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:10.871489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] validate_networks() for [('3c408952-a8f7-48c3-935f-d12a5087c0dd', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:48:11.072142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:11.072753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:11.080059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.080644 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.081464 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.082087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.244138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:11.268888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-356355be-9831-4238-a18e-605d9715d720 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.195833 Jul 28 17:48:11.270937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 223/438] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:11 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:11.340053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:48:11.340775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:48:11.341443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:48:11.342021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:48:11.342613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:48:11.353257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.353917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.354969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.355580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.374275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Getting quotas for project 0ef795b478944722886f1d084f49008d. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:48:11.378826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Getting quotas for user 1cd17607cef54135a91f39ccd74b6180 and project 0ef795b478944722886f1d084f49008d. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:48:11.457304 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:48:11.459735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf4d5627-03ef-4d39-8067-8e3403376675',volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:48:11.524495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:11.525939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:11.533447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.533891 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.534739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:11.535197 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:11.623317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-86f88ee3-8e98-404f-a734-00abe2caf867 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.893392 Jul 28 17:48:11.632430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 216/439] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:48:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:48:11.640722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cc1f9097-35cf-4363-8515-65501bd2466e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:11.641368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cc1f9097-35cf-4363-8515-65501bd2466e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:11.714783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cc1f9097-35cf-4363-8515-65501bd2466e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:11.730998 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cc1f9097-35cf-4363-8515-65501bd2466e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1088 microversion: 2.1 time: 0.096921 Jul 28 17:48:11.732026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 217/440] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:11 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:11.748443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:11.766661 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:11.776597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:11.778182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-abf5f199-5c92-49d2-a0b8-2047734fae6d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.261443 Jul 28 17:48:11.779114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 224/441] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:11 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:12.300662 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:12.301316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:12.309451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.309936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.310789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.311235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.477802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:12.485909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8f34feed-42a0-401e-9a6b-ff0f80c089b3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.191974 Jul 28 17:48:12.486580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 218/442] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:12 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:12.757745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:12.758407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:12.765618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.766684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.768242 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.768938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.802966 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:12.803491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:12.809847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.810297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.811072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:12.811504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:12.851854 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:12.866923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3ae22328-e6ba-4a33-8e0e-722e42231fb8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.113049 Jul 28 17:48:12.867863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 225/443] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:12 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:12.972921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:12.984279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:12.987868 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:12.989573 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e4f17395-bad4-49f8-820d-36d5685b69c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.191124 Jul 28 17:48:12.990965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 219/444] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:12 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:13.507583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:13.508193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:13.514672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:13.515405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:13.516219 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:13.516670 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:13.660563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:13.669448 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f23ca124-dc50-4b82-8f25-e5e70768bbdc tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.165668 Jul 28 17:48:13.670230 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 226/445] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:13 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:13.887849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:13.890335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:13.898068 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:13.898520 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:13.899300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:13.900082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:13.965226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:13.975565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-91017b2f-1386-4b75-b0e9-3b1aefe7042e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.091282 Jul 28 17:48:13.976566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 220/446] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:13 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:14.016201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:14.016795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:14.024031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:14.024468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:14.025236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:14.025667 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:14.169885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:14.180031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:14.182040 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:14.183409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b71cc028-4ef6-4823-a4d5-5ad97aaa584f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.171361 Jul 28 17:48:14.184105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 227/447] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:14 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:14.692523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:14.693118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:14.699150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:14.699608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:14.700373 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:14.700799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:14.848973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:14.857532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-deac536c-6b30-4c7a-ab72-c363a2dd63db tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.169280 Jul 28 17:48:14.869583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 221/448] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:14 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:14.999081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:14.999672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:15.006654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.007097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:15.007842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.008297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:15.077528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:15.085862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cf742f08-9f38-4e0f-b5fe-64d6f23fc2d5 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.090760 Jul 28 17:48:15.086427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 228/449] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:14 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:15.214288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:15.215292 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:15.222506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.222945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:15.223719 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.224152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:15.379146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:15.387909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:15.389689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:15.391123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-24b236e7-ba3d-4186-9295-27e7d05a5f1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.183097 Jul 28 17:48:15.391683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 222/450] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:15 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:15.880368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:15.881230 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:15.887477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.888005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:15.888844 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:15.898494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:16.064940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:16.073431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e6e595ac-ff91-4e4f-9c8e-f1621788a1c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.197703 Jul 28 17:48:16.074000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 229/451] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:15 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:16.106488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:16.107328 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:16.115055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:16.115637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:16.116587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:16.117116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:16.186943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:16.196582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ec44627c-af55-4b24-8178-afbea4355c15 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.093754 Jul 28 17:48:16.197580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 223/452] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:16 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:16.414596 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:16.415253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:16.421478 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:16.421927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:16.422780 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:16.423790 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:16.445890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:16.582537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:16.592193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:16.593485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:16.594685 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b36d41e3-139b-4a99-8a0a-cc09d4c0fe71 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.184127 Jul 28 17:48:16.609375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 230/453] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:16 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:17.096318 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:17.097451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:17.104113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.104565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.105365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.105807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.218178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:17.218839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:17.226754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.227205 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.228120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.228566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.243055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:17.253324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6c41a8aa-17ea-4d1b-8416-5005a0e2a97c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.160429 Jul 28 17:48:17.253860 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 224/454] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:17 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:17.301061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:17.308599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bbe1b966-139e-4a18-90bb-2c279a7a839c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.094796 Jul 28 17:48:17.309177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 231/455] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:17 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:17.619423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:17.620334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:17.627005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.628266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.629467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:17.630066 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:17.787748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:17.796101 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:17.797644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:17.798788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-04b615b9-9b97-41fe-8281-09d4071288aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.183193 Jul 28 17:48:17.799871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 225/456] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:17 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:18.281647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:18.282347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:18.289420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.289874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:18.290769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.291203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:18.329127 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:18.329815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:18.337120 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.337593 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:18.338359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.338789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:18.355324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.422839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:18.431276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2ef9d033-52e4-4909-83fd-ce77d49b4fc1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.105933 Jul 28 17:48:18.432196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 226/457] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:18 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:18.468240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:18.478375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ed53c1a2-4cd3-404e-9f9d-9215d5d4e4ac tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.200478 Jul 28 17:48:18.481376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 232/458] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:18 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:18.823843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:18.824806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:18.831672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.831995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:18.832827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:18.833290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:19.249809 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:19.260065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:19.261718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:19.263459 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f66a57dd-3cea-4e2f-98d6-ffc10ff5d79f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.443141 Jul 28 17:48:19.263827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 227/459] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:18 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:19.452080 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:19.452689 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:19.459365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:19.459818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:19.460582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:19.461017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:19.502510 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:19.503108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:19.509826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:19.510350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:19.511050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:19.511485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:19.525390 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:19.535377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c523bc9d-eff8-4312-afe8-0b4b5a2ceb2d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.087029 Jul 28 17:48:19.535961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 233/460] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:19 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:19.653940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:19.663309 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3a4b74e5-f6c5-4972-95b4-bd293760ea3a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.164579 Jul 28 17:48:19.663860 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 228/461] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:19 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:20.287674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:20.288268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:20.294391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.294829 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.295593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.296006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.425856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:20.434231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:20.435789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:20.436946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-82034638-ea8e-4f28-bcd1-3f40a71450af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.153342 Jul 28 17:48:20.437552 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 234/462] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:20 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:20.558821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:20.559359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:20.567204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.567698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.568709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.569289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.635840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:20.643948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3423363c-da78-4b64-a30b-31f3ba5c856c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1138 microversion: 2.1 time: 0.088571 Jul 28 17:48:20.644551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 229/463] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:20 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:20.684480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:20.685108 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:20.692977 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.693466 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.694237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:20.694674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:20.828060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:20.836191 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7f4b3d1a-91b8-4304-857b-f4079eabe007 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.155322 Jul 28 17:48:20.836569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 235/464] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:20 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:21.460738 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:21.461371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:21.463211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=4 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.468684 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.469133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:21.469923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.470360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:21.600300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:21.609684 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:21.611196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:21.612348 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6ed9d03d-b449-4c6a-ba34-d105fe93cb55 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.156006 Jul 28 17:48:21.612902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 230/465] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:21 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:21.665516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:21.666869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:21.674021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.674590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:21.675458 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.676187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:21.746326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:21.754246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8dda1c7e-6631-4363-b2f8-69e83e3b4de7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1130 microversion: 2.1 time: 0.093691 Jul 28 17:48:21.755121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 236/466] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:21 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1130 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:21.857420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:21.858035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:21.859900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=8 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.866218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.866667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:21.867440 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:21.867882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.007173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:22.015501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-069fcbf6-090f-4131-8041-5524d6adac66 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.161708 Jul 28 17:48:22.016065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 231/467] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:21 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:22.640484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:22.641091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:22.648079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.648613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.649480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.649982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.776716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:22.777652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:22.785804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.786903 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.787697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.788137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.796631 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:22.806338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:22.808336 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:22.809553 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5673e8dc-3545-4747-8ab5-bbc879cbc913 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.176063 Jul 28 17:48:22.810604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 237/468] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:22 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:22.878157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:22.887801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-06ccd72f-c843-4573-97d8-9f84d6cd08ac tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1204 microversion: 2.1 time: 0.115255 Jul 28 17:48:22.889715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 232/469] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:22 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1204 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:22.946290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:22.946900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:22.953375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.953843 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:22.954619 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:22.955059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.038325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:23.039136 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:23.045624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.046132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.047235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.047718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.091550 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:23.099990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-49335c3c-677e-40f3-b2b0-c5e5f5d07a0f tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1594 microversion: 2.1 time: 0.158432 Jul 28 17:48:23.100669 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 238/470] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:22 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:23.270674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:23.279914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6b23a089-74a4-4256-82f4-91076b9e8a9c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.245777 Jul 28 17:48:23.287985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 233/471] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:23 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:23.835903 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:23.837118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:23.844364 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.845088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.845892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.846474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.914107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:23.914638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:23.922511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.922962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:23.923734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:23.924161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:24.136441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:24.151184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:24.153031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:24.154432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5301c183-1fb7-4ac3-afa9-5f34f46507ef tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.323252 Jul 28 17:48:24.170150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 239/472] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:23 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:24.179743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:24.201449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6aa741a5-77bd-46cf-93b8-4ca0ae1fb217 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.289579 Jul 28 17:48:24.206611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 234/473] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:23 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:24.303284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:24.303972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:24.310181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:24.310902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:24.311691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:24.312182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:24.552522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:24.565820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-21983be2-5075-4e35-85b5-9d4ab0c8ae23 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.266457 Jul 28 17:48:24.568404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 240/474] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:24 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:24.577540 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-50776e44-109d-4072-ab67-1da7439924a8 req-d3d1238a-5f13-4be0-9943-6caf5efb5669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:24.591079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-50776e44-109d-4072-ab67-1da7439924a8 req-d3d1238a-5f13-4be0-9943-6caf5efb5669 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:24.591671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-50776e44-109d-4072-ab67-1da7439924a8 req-d3d1238a-5f13-4be0-9943-6caf5efb5669 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:24.610827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-50776e44-109d-4072-ab67-1da7439924a8 req-d3d1238a-5f13-4be0-9943-6caf5efb5669 service nova] Creating event network-changed:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:48:24.616664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-50776e44-109d-4072-ab67-1da7439924a8 req-d3d1238a-5f13-4be0-9943-6caf5efb5669 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042616 Jul 28 17:48:24.617536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 235/475] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:48:25.183820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:25.184419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:25.192639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.193418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.194370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.194948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.230857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:25.232006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:25.261378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.261830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.264032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.264542 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.409591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:25.418032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f467ada4-9415-4b10-9da0-f5ba0d7b4b6b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.191856 Jul 28 17:48:25.418707 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 236/476] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:25 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:25.455209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:25.464417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:25.467091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:25.468803 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ad7f5483-f7a1-4c58-9f56-488678dc776b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.288767 Jul 28 17:48:25.469576 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 241/477] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:25 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:25.530201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-627de667-2c45-43af-8734-3bc1689c6f29 req-6f9fdbf2-2c9a-47c3-ae9d-015bb8bcba37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:25.540278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-627de667-2c45-43af-8734-3bc1689c6f29 req-6f9fdbf2-2c9a-47c3-ae9d-015bb8bcba37 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.540873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-627de667-2c45-43af-8734-3bc1689c6f29 req-6f9fdbf2-2c9a-47c3-ae9d-015bb8bcba37 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.555197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-627de667-2c45-43af-8734-3bc1689c6f29 req-6f9fdbf2-2c9a-47c3-ae9d-015bb8bcba37 service nova] Creating event network-changed:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:48:25.560641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-627de667-2c45-43af-8734-3bc1689c6f29 req-6f9fdbf2-2c9a-47c3-ae9d-015bb8bcba37 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034437 Jul 28 17:48:25.561320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 237/478] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:48:25.588902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:25.589544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:25.595881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.596381 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.597203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:25.598449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:25.767372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:25.777716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a72d53da-edf5-4301-aa6a-eaeada943ac7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.192739 Jul 28 17:48:25.793335 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 242/479] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:25 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:26.439351 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:26.440793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:26.463989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.464445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.465244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.465681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.494783 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:26.495605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:26.503121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.506617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.507523 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.510881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.673791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:26.684931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:26.686886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:26.688091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8b9a951c-03a3-45a0-826c-a59ddcc1d960 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.197607 Jul 28 17:48:26.688654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 243/480] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:26 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:26.714152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:26.727720 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-327f3639-9d02-418c-a5a3-8ae10fa16f42 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.292325 Jul 28 17:48:26.731498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 238/481] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:26 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:26.800310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:26.801653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:26.809799 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.810493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.811528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.812210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.966329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-896398926"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:26.966860 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:26.979298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.980555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:26.985012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:26.985515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.000821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:27.009989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ebbb006d-6e42-4262-9d1e-a2a39ad47384 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.213934 Jul 28 17:48:27.025586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 244/482] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:26 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:27.223672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.network.security_group_api [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Adding security group fd1757d9-fef7-412a-9927-038fe9d6bbf2 to port 2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 Jul 28 17:48:27.580130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2996ccab-450a-4514-9650-50f34f9d20dc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action" status: 202 len: 0 microversion: 2.1 time: 0.617504 Jul 28 17:48:27.584408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 239/483] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:48:26 2022] POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:48:27.589534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:27.590160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:27.592904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-ef66792b-57ec-4a43-b41a-3181bc362330 req-904d30ac-0cc5-440f-9879-7ead76235602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:48:27.603200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.603948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.605015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.605716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.612405 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-ef66792b-57ec-4a43-b41a-3181bc362330 req-904d30ac-0cc5-440f-9879-7ead76235602 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.612976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-ef66792b-57ec-4a43-b41a-3181bc362330 req-904d30ac-0cc5-440f-9879-7ead76235602 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.626724 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-ef66792b-57ec-4a43-b41a-3181bc362330 req-904d30ac-0cc5-440f-9879-7ead76235602 service nova] Creating event network-changed:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:48:27.634803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-ef66792b-57ec-4a43-b41a-3181bc362330 req-904d30ac-0cc5-440f-9879-7ead76235602 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045699 Jul 28 17:48:27.636036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 240/484] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:48:27.713585 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:27.714301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:27.721202 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.721651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.723474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.729633 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.826660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:27.837776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f6ab6995-24b3-4ef2-9f33-9d0da264bcdf tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1640 microversion: 2.1 time: 0.252188 Jul 28 17:48:27.838284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 245/485] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:27 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1640 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:27.843026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:27.843625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:27.850131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.850777 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.851539 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:27.851964 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:27.929327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:27.938153 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:27.939970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:27.942355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-baf40b16-29b1-48bb-a5b9-fbdf56252770 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.234085 Jul 28 17:48:27.958664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 241/486] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:27 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:28.022353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:28.031436 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a66ceed4-ab3a-4d32-8d42-0db0dbb9df1f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.191866 Jul 28 17:48:28.032250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 246/487] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:27 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:28.051641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:28.052825 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:28.061029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:28.062183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:28.063331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:28.064075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:28.230826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:28.239671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-26be8a82-1bf2-438a-b4b8-206d21ee09cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.206255 Jul 28 17:48:28.240379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 242/488] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:28 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:28.966573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:28.967173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:28.973842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:28.974287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:28.975044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:28.975475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:28.979542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.052451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:29.053058 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:29.059864 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:29.061570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:29.062371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:29.062815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:29.110105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:29.122080 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:29.123592 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:29.124795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8398c5e4-9202-4789-8c91-05f3e5da1bc2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162165 Jul 28 17:48:29.125378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 247/489] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:28 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:29.200361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:29.208026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8c7609e1-0c6d-4fe7-886d-cbbde20bab5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.160033 Jul 28 17:48:29.208595 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 243/490] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:29 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:29.262458 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:29.263081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:29.269365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:29.269892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:29.270656 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:29.271094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:29.398827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:29.406755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6378150b-2441-43a5-88a0-f4d4f7fe39ca tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.148095 Jul 28 17:48:29.407319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 248/491] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:29 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:30.150098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:30.150641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:30.157116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.157586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.158340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.158767 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.229858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:30.230469 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:30.236936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.237659 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.238462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.238895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.294996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:30.304222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:30.305837 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:30.307005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ca674a8f-b083-41bc-9fdf-1f656dd6f168 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.161661 Jul 28 17:48:30.307575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 244/492] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:30 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:30.370754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:30.378142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4ce1b419-cc2a-4fba-b60d-7b47717f55d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.152880 Jul 28 17:48:30.378697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 249/493] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:30 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:30.429874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:30.430425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:30.436312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.436753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.437695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:30.438128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:30.454719 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:30.570399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:30.578475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-aa01b165-942b-4741-8121-f4d1a02abb0a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153054 Jul 28 17:48:30.579032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 245/494] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:30 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:31.330870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:31.331453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:31.338530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.338969 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.339724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.340146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.400456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:31.401699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:31.410610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.411688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.411930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.412562 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.479172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:31.487453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:31.488955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:31.490177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-38efd98c-daef-4baa-adbe-47c6375b0754 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.163144 Jul 28 17:48:31.490733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 250/495] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:31 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:31.548143 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:31.555607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f6e86391-b5a9-40c0-a730-0003aac543fd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159684 Jul 28 17:48:31.556171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 246/496] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:31 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:31.599555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:31.600155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:31.606164 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.606770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.607556 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:31.608028 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:31.737290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:31.746283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-70994cce-a269-4d7e-99d8-4814e1f844f5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.150586 Jul 28 17:48:31.746856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 251/497] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:31 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:32.513317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:32.513930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:32.521000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.521503 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.522277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.522718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.576616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:32.577202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:32.583790 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.584431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.585320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.585756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.657845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:32.666554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:32.668205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:32.669470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bee6e163-d9f4-4f44-bdf4-db0d113c2d5d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.160152 Jul 28 17:48:32.670028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 247/498] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:32 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:32.723231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:32.732680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cc62cd75-9846-4fdf-a28f-1b86e06e47ae tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159659 Jul 28 17:48:32.733978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 252/499] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:32 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:32.767972 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:32.768572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:32.774626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.775067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.775824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:32.776251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:32.903889 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:32.913010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-57e685c9-4a55-447a-b2a9-888e400bb12c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.149103 Jul 28 17:48:32.913611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 248/500] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:32 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:33.146725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:33.147114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:33.153174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.153634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.154388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.154816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.278992 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'services' on Instance uuid 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:48:33.391681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-07f6d4b1-3f75-4bf3-a951-ec0af8a399ac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments/fd0437e5-73c3-42d9-8208-2f4bf58cc11a" status: 202 len: 0 microversion: 2.1 time: 0.248829 Jul 28 17:48:33.392261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 253/501] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:48:33 2022] DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments/fd0437e5-73c3-42d9-8208-2f4bf58cc11a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:48:33.693636 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:33.694546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:33.701308 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.701785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.702556 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.702995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.755288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:33.756470 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:33.763505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.763949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.764717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.765202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.841800 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:33.850649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:33.852368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:33.853579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-74b74172-77e9-4aa4-a89e-28909e807638 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.164366 Jul 28 17:48:33.854208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 249/502] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:33 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:33.900991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:33.908732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a8acedec-4296-4deb-b5ab-76dc64a11b77 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.157989 Jul 28 17:48:33.909321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 254/503] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:33 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:33.934504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:33.935119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:33.941122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.941620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:33.942387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:33.942825 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:34.083443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:34.091739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ffc429bd-4c23-4e53-a5cf-cf92dc2232df tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.161029 Jul 28 17:48:34.092500 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 250/504] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:33 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:34.875832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:34.876460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:34.883318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:34.883767 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:34.884534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:34.884965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:34.930980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:34.931587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:34.938278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:34.938746 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:34.939502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:34.939939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:35.020341 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:35.030235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:35.031724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:35.032865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1d379c6a-57c0-421a-99b2-8f063d3512c2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.160909 Jul 28 17:48:35.033470 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 255/505] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:34 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:35.075628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:35.083125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0391e578-337e-4ac8-91dc-e94480c5439c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.156011 Jul 28 17:48:35.084157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 251/506] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:34 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:35.112907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:35.113536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:35.119564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:35.120010 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:35.120769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:35.121224 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:35.252880 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:35.261402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7381bafb-d426-4643-b49f-e3a1b1221d64 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.152307 Jul 28 17:48:35.261979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 256/507] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:35 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:36.057410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:36.058010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:36.064541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.064966 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.065759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.066209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.104135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:36.104745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:36.111463 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.111910 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.112686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.113122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.198725 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:36.207880 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:36.209586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:36.210772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-60af4257-88de-4bc2-a066-f18eb28b7ada tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.158293 Jul 28 17:48:36.211336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 252/508] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:36 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:36.247646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:36.255035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c8917b7b-8f48-430e-90d3-485c81ec9fde tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.155435 Jul 28 17:48:36.255665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 257/509] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:36 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:36.284044 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:36.284640 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:36.286468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.292397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.292838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.293628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:36.294058 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:36.421723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:36.429887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-68e6e19c-0747-490b-af47-776537a3e409 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.149638 Jul 28 17:48:36.431253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 253/510] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:36 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:37.234014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:37.234648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:37.237045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=80 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.243479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.243920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.244673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.245101 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.276087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:37.276807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:37.283598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.284122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.284973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.285536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.380812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:37.389450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:37.391280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:37.392452 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-14d25126-95e9-4c08-845e-5d1cfa88cd9e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162319 Jul 28 17:48:37.393020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 258/511] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:37 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:37.421898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:37.429854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e78ad4d0-9507-457d-bed2-815df367dd37 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.157769 Jul 28 17:48:37.430420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 254/512] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:37 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:37.451360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:37.451968 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:37.457974 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.458424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.459234 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:37.459771 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:37.589794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:37.597687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4bde8a46-07fc-4a68-aded-964101a86d26 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.150101 Jul 28 17:48:37.598253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 259/513] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:37 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:38.415761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:38.416353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:38.422957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.423395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.424153 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.424575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.450911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:38.451519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:38.458528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.458975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.459757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.460197 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.563806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:38.572743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:38.574313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:38.575482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-07cded13-f666-47ca-8419-a617f97df1c0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.164069 Jul 28 17:48:38.576083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 255/514] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:38 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:38.598625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:38.606129 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e69a24bc-e9ca-4687-8348-9209b80db492 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159071 Jul 28 17:48:38.606796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 260/515] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:38 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:38.622660 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:38.623251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:38.629225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.629674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.630436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:38.630869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:38.763641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:38.771935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-adbaca81-f877-45a0-820c-c959b3193347 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.154267 Jul 28 17:48:38.772498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 256/516] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:38 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:39.599029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:39.599625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:39.606454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.606885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.607784 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.608255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.628455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:39.629049 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:39.635941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.636390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.637175 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.637607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.744383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:39.754438 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:39.755956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:39.757117 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-952324a5-3b93-4bd1-aac8-160e7f2b36f8 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.161898 Jul 28 17:48:39.758436 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 261/517] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:39 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:39.783617 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:39.793500 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ac601b25-329f-49b9-b6cf-0ae93f67b661 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.169439 Jul 28 17:48:39.794064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 257/518] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:39 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:39.798751 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:39.799573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:39.805960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.806607 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.807416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:39.807853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:39.943320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:39.951925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4eef3e15-2536-40d5-934d-55d1ba5d1349 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.156980 Jul 28 17:48:39.952495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 262/519] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:39 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:40.783877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:40.784477 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:40.792207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.792643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.793431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.793863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.816898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:40.817626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:40.824166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.824887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.825972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.826448 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.830913 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.930824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:40.939834 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:40.941386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:40.942558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-99609eb1-df4e-4f0b-8105-ed9304325410 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162663 Jul 28 17:48:40.943126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 258/520] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:40 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:40.973206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:40.973849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:40.975446 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:40.980648 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.981100 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.981903 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:40.982337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:40.983671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0391f316-2f72-40b6-ada0-079278b3d23f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.172906 Jul 28 17:48:40.984246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 263/521] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:40 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:41.114709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:41.123139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-34bb5381-5912-4a98-85bd-6eed8334ecfd tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153857 Jul 28 17:48:41.124091 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 259/522] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:40 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:41.966978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:41.967579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:41.974064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:41.974508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:41.975265 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:41.975696 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:42.004793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:42.005429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:42.012507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:42.012959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:42.013761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:42.014199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:42.110318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:42.119562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:42.121060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:42.122245 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-04f5922e-9edc-408c-83a7-33c26319c207 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.159120 Jul 28 17:48:42.122865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 264/523] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:41 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:42.145066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:42.145693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:42.146532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:42.152321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:42.152758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:42.153542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:42.153965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:42.154547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9ee9f18b-63e8-4b3d-92c2-e103ea083065 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.153531 Jul 28 17:48:42.155324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 260/524] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:41 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:42.287851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:42.296870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b41574a3-d22e-45bb-9ddf-fad023cff903 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.155740 Jul 28 17:48:42.297479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 265/525] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:42 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:43.145644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:43.146254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:43.152997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.153483 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.154251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.154689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.175924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:43.176589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:43.184002 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.184446 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.185245 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.185680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.304811 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:43.313722 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:43.315276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:43.316448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c07f6899-6d40-44e7-8c17-2321f1089225 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.174704 Jul 28 17:48:43.317011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 261/526] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:43 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:43.322203 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:43.322811 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:43.323535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:43.328956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.329477 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.330198 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:43.330632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:43.331119 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f8401dcd-0f88-47f0-956a-3e550aa843e6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159150 Jul 28 17:48:43.334584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:43.339480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 266/527] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:43 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:43.458452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:43.466686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f20fc716-66a5-4179-ad14-bf2a71cf84a5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.148710 Jul 28 17:48:43.467251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 262/528] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:43 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:44.340594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:44.341215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:44.347805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.348252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.349014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.349477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.351808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:44.352492 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:44.358703 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.359157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.359936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.360369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.482743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:44.493214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:44.494960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:44.495245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:44.496125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5cf8534b-f182-449b-9de0-355b7f0d3fff tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.159439 Jul 28 17:48:44.496854 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 267/529] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:44 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:44.501264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:44.501869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:44.503602 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ef4e616e-32dc-4adc-ac90-2f66ce885f70 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.155755 Jul 28 17:48:44.504321 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 263/530] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:44 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:44.508809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.509285 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.510058 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:44.510500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:44.640365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:44.648544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5691896b-4792-4d1b-958a-d2eff22d378b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.150711 Jul 28 17:48:44.649099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 268/531] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:44 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:45.520302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:45.521017 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:45.525652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:45.526261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:45.528169 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.528621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.529505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.529945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.532704 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.533147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.534153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.534370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.667653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:45.671868 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:45.676528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:45.678074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:45.679316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-710fa7bd-f4cf-465d-8cfb-61590deb5bed tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.163162 Jul 28 17:48:45.679445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d3eeb35e-49a9-4950-b76a-276b967e7384 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.158145 Jul 28 17:48:45.692172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 269/532] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:45 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:45.692340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 264/533] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:45 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:45.692426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:45.692426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:45.692426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.692426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.692726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:45.692726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:45.827169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:45.837510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-964d3ea5-d0c6-4dab-bd37-b0c437854509 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.156566 Jul 28 17:48:45.838097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 270/534] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:45 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:46.700347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:46.700961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:46.703624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:46.704226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:46.707704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.708156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:46.708934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.709399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:46.711129 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.711573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:46.712326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.712748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:46.845692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:46.846105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:46.854851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cdbe1deb-b948-4095-9364-e96ee3740a67 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.158309 Jul 28 17:48:46.855437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 265/535] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:46 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:46.855570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:46.857106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:46.858342 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c957872c-9763-4ac7-816c-76a99c2633ee tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.158547 Jul 28 17:48:46.859023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 271/536] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:46 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:46.860178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:46.860771 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:46.866934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.867377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:46.868367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:46.868728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:47.000989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:47.009693 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1117bc9b-b54e-4645-adc4-7daf2cd9814b tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153312 Jul 28 17:48:47.011601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 266/537] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:46 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:47.875963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:47.876721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:47.881215 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:47.881856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:47.883252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:47.883683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:47.884459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:47.884891 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:47.889048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:47.889626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:47.890571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:47.891253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:48.024641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:48.027699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:48.032283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5858de7b-4db2-4c1a-8420-8ed7f28c03ba tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.160152 Jul 28 17:48:48.045306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 272/538] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:47 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:48.045507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:48.045624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:48.045624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:48.045770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:48.045770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a3c3de9f-63af-47bc-a886-ea33548f68fe tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162575 Jul 28 17:48:48.045770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 267/539] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:47 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:48.045997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:48.045997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:48.046155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:48.046465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:48.177493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:48.187297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d9cf8ffe-ce91-44d6-a15e-a30c2c65b1e2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153377 Jul 28 17:48:48.187881 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 273/540] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:48 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:49.054748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:49.055619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:49.062394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.062841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.063614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.063771 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:49.064214 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.064314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:49.071471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.071921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.072691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.073125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.198078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:49.207310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e610b1fb-1a32-47d7-96b4-668ff31b82cd tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.156850 Jul 28 17:48:49.207919 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 268/541] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:49 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:49.212597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:49.213232 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:49.218680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:49.219442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.219943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.220855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:49.221176 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:49.231286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:49.232885 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:49.234826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-862455de-b15c-4fd9-a2ba-a0230b5407ca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.174220 Jul 28 17:48:49.235407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 274/542] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:49 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:49.369606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:49.377651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-92b889fb-5a13-4909-b7a9-7379a8df2195 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.168719 Jul 28 17:48:49.378220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 269/543] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:49 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:50.227915 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:50.228604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:50.235306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.235753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.236512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.236947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.258708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:50.259884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:50.266703 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.267153 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.267923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.268361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.372889 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:50.383655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c7a244e7-560d-49c8-affe-d3258784f1df tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159518 Jul 28 17:48:50.385267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 275/544] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:50 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:50.403076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:50.403682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:50.410192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.410640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.411412 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:50.411845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:50.417552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:50.425947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:50.427453 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:50.428617 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f441631e-4cf6-41a0-b060-1662e0f822ae tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.173799 Jul 28 17:48:50.429511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 270/545] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:50 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:50.562118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:50.570073 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bd78c696-c2b9-44df-9bd2-1f917ecbc609 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.171437 Jul 28 17:48:50.570637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 276/546] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:50 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:51.406884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:51.407498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:51.414179 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.414637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.416238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.416750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.452224 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:51.453903 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:51.463102 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.463551 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.464522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.464959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.562518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:51.570089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-861fbe9b-ba59-4c06-8b63-49436d533874 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.167630 Jul 28 17:48:51.571041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 271/547] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:51 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:51.594518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:51.595846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:51.604508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.605813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.606786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:51.608059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:51.626302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:51.638480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:51.640374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:51.641991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d2140fe3-9750-4115-af0d-0ce63560dc38 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.193768 Jul 28 17:48:51.652809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 277/548] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:51 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:48:51.746379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:51.754447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1d058c34-537f-4d49-849b-dc85c77b5002 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.165693 Jul 28 17:48:51.755016 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 272/549] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:51 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:52.592007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:52.592535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:52.599203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.599643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.600389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.600814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.670256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:52.671108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:52.678697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.679233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.680082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.680590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.739216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:52.748008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-832f5cd1-bc63-4d74-8993-a3ea7f0fec2b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159803 Jul 28 17:48:52.748563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 278/550] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:52 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:52.777763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:52.778371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:52.784411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.784856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.785653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:52.786087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:52.823755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:52.834681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:52.836174 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:52.837538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3fc4a08c-512c-4ab9-808d-08deddf87657 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.171326 Jul 28 17:48:52.838682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 273/551] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:52 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:52.920740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:52.924262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:52.929623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-38137278-2985-462c-a357-2ca808131bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.155766 Jul 28 17:48:52.930202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 279/552] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:52 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:53.773118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:53.774196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:53.781805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.782247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:53.783012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.783445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:53.862491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:53.863199 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:53.870262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.870814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:53.871887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.872653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:53.923121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:53.932892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3e40380c-bc43-4844-9f13-e6cac2b04d53 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.166615 Jul 28 17:48:53.933502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 274/553] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:53 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:53.951850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:53.952510 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:53.958664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.959112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:53.959876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:53.960780 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:54.013692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:54.022742 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:54.024253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:54.026733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bae02289-6837-43cd-89d1-f75123113073 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.168773 Jul 28 17:48:54.027244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 280/554] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:53 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:54.093343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:54.101839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c67f5f3b-0a70-4efe-9342-5d5ad8928057 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153831 Jul 28 17:48:54.102535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 275/555] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:53 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:54.953650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:54.954263 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:54.960815 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:54.961304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:54.962572 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:54.963070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:55.050172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:55.050894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:55.057071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:55.057634 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:55.058511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:55.059020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:55.098775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:55.107498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5541593f-2b6f-4f3a-8ae3-926f9626980b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.157624 Jul 28 17:48:55.108176 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 281/556] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:54 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:55.123066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:55.123952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:55.130098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:55.130618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:55.131482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:55.131978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:55.196075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:55.205498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:55.207012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:55.208179 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-895069c8-a142-4846-b296-0cf0d32ab630 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162049 Jul 28 17:48:55.208742 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 276/557] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:55 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:55.265246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:55.273490 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a134a2fd-0e84-4d23-9a9c-d991f96035c0 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.154261 Jul 28 17:48:55.274072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 282/558] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:55 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:56.131342 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:56.131884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:56.138981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.139427 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.140199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.140632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.232763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:56.233395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:56.239724 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.240163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.240916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.241375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.279475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:56.287160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-39fc341c-5377-4bf2-a22a-6b4813210cb7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.159827 Jul 28 17:48:56.287743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 277/559] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:56 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:56.295519 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:56.296328 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:56.302516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.303096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.303982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:56.304526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:56.393573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:56.402835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:56.404449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:56.405755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-62ee792f-189b-48c4-a1bb-857b532b07d5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.177855 Jul 28 17:48:56.406429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 283/560] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:56 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:56.434382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:56.436592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.443679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d5dd2bcd-76db-462b-9948-f7f9215614c9 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.151830 Jul 28 17:48:56.444252 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 278/561] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:56 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:57.316984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:57.317583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:57.325006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.325484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.326243 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.326673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.430732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:57.432075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:57.438988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.439442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.440224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.440660 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.460697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:57.468805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1af7cdfa-d2d2-4ace-b0fc-ec0dc0b2a07f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.155697 Jul 28 17:48:57.469577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 284/562] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:57 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:57.481296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:57.481296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:57.481296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.481296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.481938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:57.482370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:57.584043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:57.592797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:57.594337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:57.595505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-14a24e3f-626e-4f94-a324-ecbec0dd8ce4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.169502 Jul 28 17:48:57.607148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 279/563] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:57 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:57.614933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:57.623577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f109793d-c683-4dfd-97f6-d4344c7e1d4a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153056 Jul 28 17:48:57.624143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 285/564] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:57 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:58.494521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:58.495144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:58.501627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.502083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.502861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.503301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.619582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:58.620217 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:58.627637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.628478 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.629892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.630659 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.637594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:58.646123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2d2e9d67-b8a9-44c7-b1d9-d49154b920db tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.155313 Jul 28 17:48:58.646628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 280/565] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:58 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:58.651940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:58.652536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:58.660409 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.660981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.661866 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:58.662378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:58.777829 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:58.787093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:58.788611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:58.789838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ea615ee4-c2fc-4580-8d5d-85489d6bab8e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.174437 Jul 28 17:48:58.790447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 286/566] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:58 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:48:59.049878 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:59.057961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bc41f552-38b0-441e-9d7f-df473a887203 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.410397 Jul 28 17:48:59.058527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 281/567] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:58 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:59.667667 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:59.668233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:59.674693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:59.675146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:59.675939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:59.676374 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:59.813994 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:48:59.814594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:48:59.820712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:59.821152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:59.822794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:59.827008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:48:59.827444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:48:59.832932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-46018825-6914-4bad-bc60-607842166d73 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.169242 Jul 28 17:48:59.833698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 287/568] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:48:59 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:59.968332 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:59.977042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:59.979412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:48:59.995570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ca26b3e2-ec81-453a-b8b7-ed814929b05a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.170473 Jul 28 17:48:59.996222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 282/569] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:48:59 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:00.078749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:00.079366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:00.085541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:00.085993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:00.086969 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:00.087482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:00.146267 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-56e048b8-17cc-45ff-8ebe-b398e563d11f req-c74d4592-e721-4deb-a69b-947ef8045b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "name": "network-vif-plugged", "status": "completed", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:00.162188 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-56e048b8-17cc-45ff-8ebe-b398e563d11f req-c74d4592-e721-4deb-a69b-947ef8045b08 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:00.163218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-56e048b8-17cc-45ff-8ebe-b398e563d11f req-c74d4592-e721-4deb-a69b-947ef8045b08 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:00.180549 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-56e048b8-17cc-45ff-8ebe-b398e563d11f req-c74d4592-e721-4deb-a69b-947ef8045b08 service nova] Creating event network-vif-plugged:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:49:00.186523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-56e048b8-17cc-45ff-8ebe-b398e563d11f req-c74d4592-e721-4deb-a69b-947ef8045b08 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046254 Jul 28 17:49:00.187577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 283/570] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:49:00.255601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:00.268712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-085013be-2b60-4f33-bb9a-2e4f8194f0ad tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.193699 Jul 28 17:49:00.269937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 288/571] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:00 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:00.856845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:00.858599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:00.866753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:00.867200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:00.868083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:00.870342 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:01.019926 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:01.020086 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:01.020511 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:01.028114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:01.028275 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-387a8c71-9c79-4c95-afc1-9f802302bdbc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.177686 Jul 28 17:49:01.028527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:01.029048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 284/572] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:00 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:01.042282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:01.042282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:01.167135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:01.175516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:01.177035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:01.179211 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-96813b6a-ed87-4e23-aa21-38a5a5d55be3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.162478 Jul 28 17:49:01.179789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 289/573] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:01 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:01.292899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:01.293434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:01.299366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:01.299808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:01.300558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:01.300986 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:01.433354 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:01.441508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d3b761f0-9bfc-4992-97bc-a0b3be276272 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153496 Jul 28 17:49:01.442076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 285/574] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:01 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:02.049851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:02.050512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:02.057050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.057525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.058284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.058719 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.192731 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:02.201110 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a3f83c09-467b-496a-bb0c-256e5d14bbb1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.155032 Jul 28 17:49:02.201717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 290/575] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:02 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:02.203536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:02.204357 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:02.210710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-c46bfe97-5f32-4d40-be01-6e1d6efca714 req-112abad0-7c12-4ef8-b136-40940da7aa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:02.211320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.211995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.213746 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.214364 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.221021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-c46bfe97-5f32-4d40-be01-6e1d6efca714 req-112abad0-7c12-4ef8-b136-40940da7aa8b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.221508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-c46bfe97-5f32-4d40-be01-6e1d6efca714 req-112abad0-7c12-4ef8-b136-40940da7aa8b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.232146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-c46bfe97-5f32-4d40-be01-6e1d6efca714 req-112abad0-7c12-4ef8-b136-40940da7aa8b service nova] Creating event network-vif-plugged:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:49:02.237114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-c46bfe97-5f32-4d40-be01-6e1d6efca714 req-112abad0-7c12-4ef8-b136-40940da7aa8b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029821 Jul 28 17:49:02.237738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 291/576] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:49:02.356876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:02.365280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:02.366930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:02.368083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7771d621-4d5f-405b-b273-431062807c21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.168996 Jul 28 17:49:02.368913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 286/577] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:02 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:02.463733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:02.464429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:02.470738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.471186 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.471953 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:02.472389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:02.599798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:02.607862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2583315e-4d26-4b12-8f56-f646cb639a49 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.148540 Jul 28 17:49:02.608482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 292/578] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:02 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:03.222345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:03.222950 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:03.230579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.231029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.231793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.232227 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.374922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:03.382447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0a4ef06d-0a5a-4369-a5c7-54d0efb626ca tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.163805 Jul 28 17:49:03.383009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 287/579] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:03 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:03.391707 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:03.392336 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:03.398921 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.399364 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.401096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.401585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.533226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:03.541512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:03.543022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:03.544172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-897452d3-bacf-4d4b-9664-8663b8002782 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.156568 Jul 28 17:49:03.544734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 293/580] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:03 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:03.630448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:03.630970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:03.637931 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.638400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.639159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:03.639587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:03.775539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:03.783814 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6e1a5887-a91f-4460-9d57-06ecd3603cee tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.157233 Jul 28 17:49:03.784379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 288/581] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:03 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:04.403254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:04.403863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:04.410683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.411135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.411899 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.412331 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.542306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:04.549664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c308d6ab-aeed-4a2e-9df9-60d22f78579b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.150284 Jul 28 17:49:04.550225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 294/582] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:04 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:04.566765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:04.567370 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:04.573946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.574390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.575150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.575580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.706038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:04.714909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:04.716414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:04.717604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9d63641a-55bf-4e12-874b-c72838e2d67f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.154686 Jul 28 17:49:04.718168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 289/583] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:04 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:04.804934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:04.805479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:04.812096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.812540 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.813332 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:04.813760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:04.947538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:04.955414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-628d66bf-d959-4928-aa59-4be38bb94eb7 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.154371 Jul 28 17:49:04.955986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 295/584] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:04 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:05.388625 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:05.390991 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:05.397451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.397900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.398663 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.399101 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.469599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ba0b5aa6-53b9-4486-a6fc-57d2ade14b0b tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action" status: 202 len: 0 microversion: 2.1 time: 0.085129 Jul 28 17:49:05.470315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 290/585] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:49:05 2022] POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:49:05.478558 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:05.479165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:05.485698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.486139 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.486886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.487314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.572255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:05.572957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:05.579803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.580250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.581020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.581487 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.631283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:05.639983 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-39a48b81-f368-45d4-ab02-c593eb646af7 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.165487 Jul 28 17:49:05.640641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 296/586] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:05 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:05.718326 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:05.725796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-36c30817-a745-4214-8158-6bd26d2cefa2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.158393 Jul 28 17:49:05.726361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 291/587] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:05 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:05.741171 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:05.741778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:05.748927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.749416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.750181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.750614 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.754874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:05.884731 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:05.893616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:05.895153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:05.896325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-12bcaaa3-90ab-46ad-b645-a6c2f22fa733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.158998 Jul 28 17:49:05.897075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 297/588] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:05 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:05.980222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:05.980835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:05.986899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.987349 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:05.988118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:05.988568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.120775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:06.128726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-916acc14-1499-4b23-9ee2-a1b535f33907 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153052 Jul 28 17:49:06.129314 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 292/589] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:05 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:06.661998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:06.662597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:06.669818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.670258 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.671005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.671432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.746418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:06.747065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:06.750715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=80 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:06.754733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.755187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.755962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.756393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.817414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:06.828779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e5f5642a-cd3d-4f2b-8dc7-130cecc6a00d tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.170385 Jul 28 17:49:06.830113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 298/590] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:06 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:06.891753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:06.900386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a03ca583-263e-4eda-b416-a83ab7d5852b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.156896 Jul 28 17:49:06.901038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 293/591] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:06 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:06.920112 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:06.920654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:06.926701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.927144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:06.927897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:06.928327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.059684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:07.068118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:07.069658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:07.070816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6caa8beb-4de8-48e6-b664-3eeca9c95c5b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.154755 Jul 28 17:49:07.071377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 299/592] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:06 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:07.151118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:07.151720 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:07.157723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.158177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.158935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.159366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.294844 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:07.302755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-70194f91-48e7-4112-9d3a-ed5caea03e10 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.155449 Jul 28 17:49:07.303322 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 294/593] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:07 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:07.850654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:07.851325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:07.854799 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=84 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:07.860411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.860851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.861630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.862058 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.921536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:07.922303 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:07.928940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.929456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.930233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:07.930674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:07.934739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.012769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.021201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ddaef51b-6b5b-4041-9c5a-9bac93d9dd53 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.174312 Jul 28 17:49:08.021992 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 300/594] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:07 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:08.065712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.073768 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b810ae99-9d81-4d69-9fe8-9b9ed56a5e4b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.156772 Jul 28 17:49:08.074333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 295/595] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:07 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:08.094423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:08.094955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:08.100899 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:08.101379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:08.102131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:08.102558 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:08.231456 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.239975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.241494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.242632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-52d30df3-491c-4c52-a9c2-cf0f959faaea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.152202 Jul 28 17:49:08.243191 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 301/596] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:08 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:08.325599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:08.326237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:08.332338 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:08.332782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:08.333591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:08.334030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:08.467688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:08.475664 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f182a064-4549-4919-9e2b-a8a868dbcc1a tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.154491 Jul 28 17:49:08.476224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 296/597] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:08 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:09.043604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:09.044209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:09.051127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.051578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.052344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.052778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.094447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:09.094974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:09.101599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.102050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.103041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.103278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.204503 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.212686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5014beae-63ca-4bf0-818c-a0ded6fba44e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.173344 Jul 28 17:49:09.213381 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 302/598] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:09 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:09.239480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.247461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-81099a06-2643-499d-813f-c9a749077f93 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.156906 Jul 28 17:49:09.248036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 297/599] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:09 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:09.266057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:09.266943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:09.272898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.273385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.274170 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.274611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.407314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.416330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.417894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.419034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3947c6be-6b25-4d6c-9b12-2b1c482b8322 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.156809 Jul 28 17:49:09.419586 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 303/600] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:09 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:09.496177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:09.496786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:09.502814 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.503265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.504041 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:09.504480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:09.636822 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:09.645067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-82aa3212-ee6e-455e-9a35-36e59115a62c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.153222 Jul 28 17:49:09.645659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 298/601] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:09 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:10.233658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:10.234294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:10.240805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.241281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.242043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.242474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.269102 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:10.269745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:10.277657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.278104 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.278869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.279300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.388234 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.397609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0bab78a1-86a8-4051-8999-e0efa38d1420 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.167305 Jul 28 17:49:10.399380 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 304/602] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:10 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:10.418600 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.426051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-575fd906-3333-4f9c-9c69-2a4d5b44af24 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.161182 Jul 28 17:49:10.426620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 299/603] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:10 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:10.442221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:10.442827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:10.449332 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.449778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.450538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.450972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.581894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.590856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.592349 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.593544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a93b7d33-a485-4311-bf71-a5675215d01b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.155127 Jul 28 17:49:10.594098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 305/604] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:10 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:10.666331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:10.666937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:10.673082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.673566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.674329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:10.674767 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:10.804882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:10.814190 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c4a2f716-7638-4663-bbae-44988396d3c2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.151769 Jul 28 17:49:10.814765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 300/605] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:10 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:11.423509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:11.424580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:11.431630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.432082 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.432875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.433347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.446726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:11.448182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:11.454127 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.454635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.455355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.455794 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.585935 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.594653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1363f407-f3e7-4b49-8cfa-cc9989be620e tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.178576 Jul 28 17:49:11.595542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 306/606] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:11 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:11.614609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.617845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:11.618529 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:11.623709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4ccb6282-835f-492b-8240-121e57b00630 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.180788 Jul 28 17:49:11.624430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 301/607] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:11 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:11.625602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.626057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.626846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.627267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.776776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.785445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.786961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.788126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dfb82926-5235-4abe-a12c-12ae8eb060d6 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.175976 Jul 28 17:49:11.788686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 307/608] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:11 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:11.839279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:11.840094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:11.846447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.846763 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.847548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:11.847989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:11.982268 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:11.990408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bcb4193f-e546-41e2-8e61-077900b7425e tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.157983 Jul 28 17:49:11.990975 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 302/609] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:11 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:12.616427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:12.617029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:12.624395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.624835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.625628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.626087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.647042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:12.647732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:12.655007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.655457 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.656239 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.656684 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.777081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:12.785198 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4f371fd8-b242-430e-ad86-68038e7383ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1632 microversion: 2.1 time: 0.172730 Jul 28 17:49:12.785863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 308/610] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:12 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1632 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:12.800650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:12.809897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-17a30079-766d-4e09-a203-905c7f95dac7 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.168332 Jul 28 17:49:12.811122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 303/611] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:12 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:12.813897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:12.814900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:12.822297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.823260 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.824459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:12.825125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:12.971580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:12.981991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:12.983521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:12.984641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-51bb6c89-efd5-407c-b438-5c13b8d5d184 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.175987 Jul 28 17:49:12.985286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 309/612] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:12 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:13.011594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:13.012205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:13.018504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.018945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.019728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.020160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.148996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:13.157545 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-57c077d8-a839-457b-9b5f-f0352e1d28e3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1733 microversion: 2.1 time: 0.149925 Jul 28 17:49:13.158115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 304/613] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:13 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:13.808701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:13.809475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:13.816831 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.817289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.818068 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.818497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.840639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:13.841538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:13.848284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.848796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.849672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:13.850125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:13.995458 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.005076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-41479a5d-a5ef-4216-8521-acad9a1033a1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.200903 Jul 28 17:49:14.005890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 310/614] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:13 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:14.011450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:14.012591 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:14.019013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.019444 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.020206 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.020827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.071605 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.080255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d443df93-d86e-4726-8462-8dc7580a130a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.244951 Jul 28 17:49:14.080966 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 305/615] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:13 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:14.155661 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.164686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.166237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.167426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-adfe9b7a-7a6f-4864-a226-ffe23ce69c0d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.160417 Jul 28 17:49:14.167993 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 311/616] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:14 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:14.179242 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:14.179854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:14.186023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.186468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.187233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.187668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.319043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.327602 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cf164357-fb28-4c53-8f5b-a37c2cdd6be6 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1713 microversion: 2.1 time: 0.152114 Jul 28 17:49:14.328164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 306/617] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:14 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:14.470308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:14.471055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:14.477185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.477673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.478459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.478982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.569851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] HTTP exception thrown: Cannot 'detach_volume' instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 while it is in vm_state rescued Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Request method failure captured: Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments/0cf32f5b-1856-4fdf-ae2b-2e3817d873e4 HTTP/1.1 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssD9OJJzzVfPx5S_-itysl29heH3jm_R51nRL0_U21QoHQjQFI_mITdJuD3ZXDjocSXncShXuQtbfpAKwkKvmB9E0hOSOiO5Pgc591kcL0cquikobxlrYwQjVQPZQDslrW6oum9fkIfZs68nFoWSuqPTrNr-eQf14Y66ZdN5hc39_g Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:49:14.573301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_f5332e245b754728b04af219fdb6ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 14327b8153ab4de782d4bcfef7681fc1 Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:49:14.574996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Cannot 'detach_volume' instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 while it is in vm_state rescued Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'server_id': 'ef3b9253-025e-4a8d-af04-b8951ed85ae8', 'id': '0cf32f5b-1856-4fdf-ae2b-2e3817d873e4'} Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:49:14.575720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 while it is in vm_state rescued Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 while it is in vm_state rescued Jul 28 17:49:14.576948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:49:14.579041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Returning 409 to user: Cannot 'detach_volume' instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 while it is in vm_state rescued {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:49:14.580052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6a666a49-9e00-4c7a-8698-37743e23a890 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments/0cf32f5b-1856-4fdf-ae2b-2e3817d873e4" status: 409 len: 152 microversion: 2.1 time: 0.113745 Jul 28 17:49:14.580948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 312/618] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:49:14 2022] DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments/0cf32f5b-1856-4fdf-ae2b-2e3817d873e4 => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 17:49:14.589604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:14.590270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:14.596823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.597188 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.598198 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.598790 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.668586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ad555f4f-d722-4359-8d74-1cda8f91eb90 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/action" status: 202 len: 0 microversion: 2.1 time: 0.082978 Jul 28 17:49:14.672441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 307/619] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:49:14 2022] POST /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:49:14.677940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:14.678628 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:14.685781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.686300 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.687063 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:14.687491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:14.827346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:14.832334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.839725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-817b1844-3333-4ecf-abac-76efeb08deff tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.165563 Jul 28 17:49:14.840394 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 313/620] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:14 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:15.029145 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:15.029796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:15.036049 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.036502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.037307 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.037749 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.102096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:15.102816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:15.109564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.110012 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.110810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.111241 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.187233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:15.201881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-15761590-e723-456e-b99c-32337e7be9ef tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.178027 Jul 28 17:49:15.202469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 308/621] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:15 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:15.208038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:15.208915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:15.216818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.217548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.218647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.219367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.261681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:15.269475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f9b528b2-ac6d-4673-adfe-23bf3508e2bc tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.171466 Jul 28 17:49:15.270318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 314/622] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:15 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:15.378429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:15.387164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:15.388700 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:15.389887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c611195f-8afd-4295-a64d-8014a99a1813 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.186306 Jul 28 17:49:15.390443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 309/623] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:15 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:15.859781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:15.860388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:15.866846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.867306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.868067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.868677 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.895667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0d82f4f2-d07a-42cb-96dc-147f2ced6ef3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:15.903259 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0d82f4f2-d07a-42cb-96dc-147f2ced6ef3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:15.903756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0d82f4f2-d07a-42cb-96dc-147f2ced6ef3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:15.966433 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0d82f4f2-d07a-42cb-96dc-147f2ced6ef3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Going to try to stop instance {{(pid=124516) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 17:49:15.971437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:16.011029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.018920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0d82f4f2-d07a-42cb-96dc-147f2ced6ef3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action" status: 202 len: 0 microversion: 2.1 time: 0.127172 Jul 28 17:49:16.019546 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b393f571-7cd6-4c5e-b422-eb88ab858f12 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.163516 Jul 28 17:49:16.019815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 310/624] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:49:15 2022] POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:49:16.020243 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 315/625] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:15 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:16.027934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:16.028630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:16.035252 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.035845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.036478 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.036920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.224929 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:16.225556 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:16.233361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.234024 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.235288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.236009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.320667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.328876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b47983aa-702e-4d30-863a-a655290ba3be tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.304942 Jul 28 17:49:16.329875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 311/626] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:16 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:16.339279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:16.340361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:16.347580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.347876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.348652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.349293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.401680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.411601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-35669d2c-5e20-4663-b880-abbb955d9af0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.191108 Jul 28 17:49:16.413079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 316/627] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:16 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:16.418435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:16.419269 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:16.429032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.429719 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.430996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:16.431720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:16.512740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.520802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c9f126a2-deda-4b57-a4e8-62ee87525379 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1260 microversion: 2.1 time: 0.189624 Jul 28 17:49:16.521273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 312/628] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:16 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:16.590631 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.599089 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.600601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:16.601791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fb21c631-a030-48f0-89e6-9d7a40a16ec1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1810 microversion: 2.20 time: 0.188125 Jul 28 17:49:16.602345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 317/629] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:16 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:49:17.041475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.042172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.048599 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.049117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.049917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.050352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.346525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.350294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.350906 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.356433 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1e1b0d74-e4ba-4b89-8f1b-12a304e8aeb2 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.318820 Jul 28 17:49:17.357017 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 313/630] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:17.358157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.358602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.359384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.359924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.438951 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.440148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.448051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.448412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.449315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.449830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.501095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.508732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9b22abd8-1162-4fbb-a472-57bcca6687e3 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.162123 Jul 28 17:49:17.509344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 318/631] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:17.541385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.542222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.548325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.548773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.549683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.550125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.607030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.615948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7d7b65a9-cbb8-405b-9f81-1d4d4317ab50 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.183594 Jul 28 17:49:17.616533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 314/632] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:17.628607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.629236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.642321 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.642769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.643546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.643975 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.690657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.699018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-40175e6d-f1fd-4149-82c0-fc44742a2372 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1444 microversion: 2.1 time: 0.161455 Jul 28 17:49:17.699597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 319/633] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:17.719933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:17.721147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:17.728103 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.728795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.729815 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:17.730415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:17.878784 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.886620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d889a72a-b6e8-4744-b52c-be0891abf218 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1444 microversion: 2.1 time: 0.170462 Jul 28 17:49:17.887293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 320/634] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:17.898246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.907978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.909677 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:17.910685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a36e1a0a-900e-4cfe-8457-55b7e1b57c16 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1797 microversion: 2.20 time: 0.286803 Jul 28 17:49:17.915658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 315/635] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:49:17 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1797 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:49:18.379959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:18.380499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:18.387001 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.387456 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.388223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.388650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.531352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:18.531958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:18.538561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.539010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.539776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.540201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.583358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:18.595000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-515fd3f9-951d-4be2-85b3-dce4384f7765 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.218908 Jul 28 17:49:18.609363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 321/636] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:18 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:18.639478 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:18.640055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:18.647231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.647778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.648733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:18.649476 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:18.682745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:18.690855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c18340af-9cef-4166-8915-30717871b45e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.163420 Jul 28 17:49:18.691754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 316/637] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:18 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:19.146031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:19.155076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-584a43ab-1b9e-448e-9d5d-04b8e6e185e1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.520761 Jul 28 17:49:19.155918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 322/638] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:18 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:19.616013 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:19.616830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:19.624284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:19.624859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:19.625777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:19.626336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:19.712210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:19.712979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:19.721333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:19.722525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:19.723482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:19.724553 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:19.788845 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:19.797778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7b6a11b2-dcf6-408e-8911-03432868db44 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.185367 Jul 28 17:49:19.798515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 317/639] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:19 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:19.962770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:19.970863 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ee454232-364c-4847-892e-741f6465b044 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.262444 Jul 28 17:49:19.971431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 323/640] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:19 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:20.154261 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-749dc2b1-d9f2-49aa-b27b-12ca4bbfc760 req-b7280328-7ccb-4f6b-a633-82bf8bc1564e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:20.163526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-749dc2b1-d9f2-49aa-b27b-12ca4bbfc760 req-b7280328-7ccb-4f6b-a633-82bf8bc1564e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:20.163947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-749dc2b1-d9f2-49aa-b27b-12ca4bbfc760 req-b7280328-7ccb-4f6b-a633-82bf8bc1564e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:20.176586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-749dc2b1-d9f2-49aa-b27b-12ca4bbfc760 req-b7280328-7ccb-4f6b-a633-82bf8bc1564e service nova] Creating event network-changed:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:49:20.177563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:20.178183 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:20.181769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-749dc2b1-d9f2-49aa-b27b-12ca4bbfc760 req-b7280328-7ccb-4f6b-a633-82bf8bc1564e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031931 Jul 28 17:49:20.184040 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 318/641] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:49:20.185593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:20.186051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:20.186840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:20.187278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:20.335924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:20.344811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a03333a5-9f0e-4d28-b8a0-be996de81ba3 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1751 microversion: 2.1 time: 0.171459 Jul 28 17:49:20.345429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 324/642] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:20 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:20.819380 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:20.820177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:20.827965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:20.828420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:20.829225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:20.829665 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:20.969575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:20.978084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0c879ac2-c5a4-44f7-9f09-e97fa173bf11 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1721 microversion: 2.1 time: 0.162926 Jul 28 17:49:20.978783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 319/643] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:20 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:20.992080 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:20.994545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:21.002655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:21.003301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:21.004082 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:21.004547 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:21.163522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:21.172327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0d59b30a-0f36-4094-ae71-c437ed8b541a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.184068 Jul 28 17:49:21.172892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 325/644] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:20 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:21.367070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:21.367591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:21.374081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:21.374527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:21.375282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:21.375710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:21.600273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:21.608225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-255042a1-1299-4542-b0c9-4519ac1503bd tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.245117 Jul 28 17:49:21.608795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 320/645] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:21 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:21.999940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:22.000600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:22.007347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.007796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.008575 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.009010 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.146891 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:22.155888 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3e68e488-60a7-4f89-ba1e-b4a618094b7c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1727 microversion: 2.1 time: 0.159821 Jul 28 17:49:22.156477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 326/646] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:21 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:22.177347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:22.177891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:22.184740 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.185225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.186015 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.186453 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.194054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:22.194788 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:22.202356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.202947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.203837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.205035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.311375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7d7689a6-be1f-4b04-9faf-c996252f7950 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137859 Jul 28 17:49:22.312070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 321/647] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:49:22 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:49:22.345758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:22.353463 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8275dc74-6621-439f-9a08-f3c544a899e2 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.163305 Jul 28 17:49:22.354809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 327/648] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:22 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:22.630102 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:22.630915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:22.638254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.638924 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.639789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:22.640415 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:22.888106 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:22.897461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d7c40819-e327-4f2f-91b2-67586f727915 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.271123 Jul 28 17:49:22.908719 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 322/649] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:22 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:23.376757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:23.378063 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:23.386429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:23.387373 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:23.388232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:23.388742 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:23.398967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-6b3c47ee-b517-4282-8404-8fb47ed4b581 req-7adde979-ef64-46d1-a56a-da736700beb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:23.417047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6b3c47ee-b517-4282-8404-8fb47ed4b581 req-7adde979-ef64-46d1-a56a-da736700beb4 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:23.417624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6b3c47ee-b517-4282-8404-8fb47ed4b581 req-7adde979-ef64-46d1-a56a-da736700beb4 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:23.431752 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-6b3c47ee-b517-4282-8404-8fb47ed4b581 req-7adde979-ef64-46d1-a56a-da736700beb4 service nova] Creating event network-changed:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:49:23.437478 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-6b3c47ee-b517-4282-8404-8fb47ed4b581 req-7adde979-ef64-46d1-a56a-da736700beb4 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042986 Jul 28 17:49:23.438185 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 323/650] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:49:23.551590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:23.560371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c599df39-7eee-4806-8254-7138d114d92c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.187712 Jul 28 17:49:23.560948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 328/651] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:23 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:23.920580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:23.921313 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:23.927794 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:23.928229 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:23.929018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:23.929489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:24.148301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:24.161094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-78b9922a-ea57-4ca3-80cb-ffc354b02156 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.245311 Jul 28 17:49:24.161721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 324/652] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:23 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:24.582451 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:24.583066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:24.591302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:24.591973 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:24.593138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:24.593832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:24.835356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:24.843995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-be58bc10-d51a-43e3-bc70-823987067937 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.265445 Jul 28 17:49:24.845316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 329/653] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:24 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:25.184160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:25.184763 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:25.191128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:25.191626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:25.192386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:25.192813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:25.338880 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:25.346996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d352bfe3-04de-4f95-90f2-7b17ddcc5146 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.167336 Jul 28 17:49:25.347569 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 325/654] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:25 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:25.452879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-1dd6145b-ac69-4231-bf82-4ba496fd81be req-30409904-2d82-40f3-aca7-99e9b40331da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:25.462799 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-1dd6145b-ac69-4231-bf82-4ba496fd81be req-30409904-2d82-40f3-aca7-99e9b40331da service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:25.463961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-1dd6145b-ac69-4231-bf82-4ba496fd81be req-30409904-2d82-40f3-aca7-99e9b40331da service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:25.475062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-1dd6145b-ac69-4231-bf82-4ba496fd81be req-30409904-2d82-40f3-aca7-99e9b40331da service nova] Creating event network-changed:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:49:25.480672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-1dd6145b-ac69-4231-bf82-4ba496fd81be req-30409904-2d82-40f3-aca7-99e9b40331da service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031926 Jul 28 17:49:25.481253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 330/655] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:49:25.867414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:25.868413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:25.879088 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:25.879941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:25.881151 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:25.882093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:26.137603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:26.145382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e23df967-dd4b-4990-9038-dca3205f9f97 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1676 microversion: 2.1 time: 0.283131 Jul 28 17:49:26.146150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 326/656] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:25 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1676 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:26.368893 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:26.369621 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:26.376408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:26.376854 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:26.377642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:26.378077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:26.382205 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:26.529567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:26.537584 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a2b525bb-b0cf-46e5-9e55-058abc1dadce tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.173353 Jul 28 17:49:26.538159 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 331/657] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:26 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:27.168192 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:27.168802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:27.175395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.175850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.176622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.177060 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.310132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:27.317980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9f3f7162-483d-4d9a-8626-81f8b9afcbeb tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1653 microversion: 2.1 time: 0.154409 Jul 28 17:49:27.318545 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 327/658] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:27 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:27.338923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-44a5641c-950f-4184-8067-9d16dc32cc80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:49:27.345295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44a5641c-950f-4184-8067-9d16dc32cc80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.345778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-44a5641c-950f-4184-8067-9d16dc32cc80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.367386 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-44a5641c-950f-4184-8067-9d16dc32cc80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Going to try to start instance {{(pid=124515) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 17:49:27.410121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-44a5641c-950f-4184-8067-9d16dc32cc80 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action" status: 202 len: 0 microversion: 2.1 time: 0.074914 Jul 28 17:49:27.410796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 332/659] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:49:27 2022] POST /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:49:27.419547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:27.420090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:27.426254 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.426700 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.427492 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.427920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.432199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:27.560459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:27.560855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:27.561178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:27.568447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dddaa121-e0e8-4814-823e-1c4cde1b9797 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1662 microversion: 2.1 time: 0.153055 Jul 28 17:49:27.568682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.569019 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 328/660] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:27 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:27.577275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.578207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:27.578653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:27.724359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:27.733508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3da3fe4d-6af3-4a93-bb35-c20afb0a15d1 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.177933 Jul 28 17:49:27.734090 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 333/661] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:27 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:49:28.590762 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:28.591366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:28.597982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:28.598431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:28.599193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:28.599629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:28.733362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:28.740968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c95dff7c-bf56-4e47-bdf4-9c326dda679b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1662 microversion: 2.1 time: 0.154696 Jul 28 17:49:28.741567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 329/662] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:28 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:28.755690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:28.756294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:28.763165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:28.763608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:28.764361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:28.764789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:28.912562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:28.921508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e792b66c-fcd6-472e-a203-1ccfd97913a2 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.169444 Jul 28 17:49:28.922288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 334/663] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:28 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:29.762623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:29.763278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:29.770020 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:29.770465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:29.771218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:29.771653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:29.901410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:29.910751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-992f5709-5fd5-4af5-bb89-94bf1b50c06d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1666 microversion: 2.1 time: 0.152372 Jul 28 17:49:29.911337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 330/664] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:29 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:29.942990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:29.943594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:29.950627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:29.951305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:29.952475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:29.953131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:30.100594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:30.109739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f24cc2c1-5c0c-4733-81d5-89096bf7589c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.170543 Jul 28 17:49:30.110310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 335/665] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:29 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:31.131242 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:31.131773 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:31.139258 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:31.139701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:31.140460 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:31.140933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:31.283768 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:31.291647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f37881ff-97e5-4c82-a9b7-55bb16ca26c8 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.164318 Jul 28 17:49:31.292209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 331/666] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:31 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:32.313490 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:32.314085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:32.320672 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:32.321108 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:32.321889 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:32.322310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:32.468098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:32.475974 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-af5cff2f-4c76-42b9-b0d1-4585fe8efcfc tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.166426 Jul 28 17:49:32.476532 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 336/667] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:32 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:33.496942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:33.497650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:33.504473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:33.504937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:33.505753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:33.506203 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:33.661876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:33.676462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1be75cef-90a4-4078-9eb1-d2f8ac1ec11c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.183738 Jul 28 17:49:33.677042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 332/668] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:33 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:34.700025 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:34.700640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:34.707212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:34.707658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:34.708414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:34.708845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:34.851514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:34.860385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c45c599e-6828-4e4d-bcbd-39dd2357d978 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.164247 Jul 28 17:49:34.860954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 337/669] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:34 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:35.882415 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:35.883024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:35.890053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:35.890503 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:35.891674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:35.892079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:36.046725 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:36.054892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-eb6add73-b7fc-43dc-9153-0cb6564110ee tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.176311 Jul 28 17:49:36.055465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 333/670] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:35 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:37.077326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:37.077948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:37.084551 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:37.084939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:37.085739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:37.086173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:37.231658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:37.239797 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ace1252f-8c54-446f-815b-b9ae378626db tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.167078 Jul 28 17:49:37.240367 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 338/671] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:37 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:38.260881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:38.262486 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:38.264379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=82 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:38.270123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:38.270574 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:38.271351 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:38.271788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:38.422846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:38.430818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7a029c73-b0e8-4411-8e2c-fc4d5d84c101 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1756 microversion: 2.1 time: 0.173852 Jul 28 17:49:38.431384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 334/672] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:38 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:39.453706 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:49:39.454305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:49:39.456333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=78 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:39.461687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:39.462126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:39.462878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:49:39.463308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:49:39.610127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:49:39.618964 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5086a1ea-d31e-4a2a-bb50-487e875967e0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1759 microversion: 2.1 time: 0.169457 Jul 28 17:49:39.619537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 339/673] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:49:39 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:49:43.697495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 17:49:43.698174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 17:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 17:50:00.938828 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:00.939672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=41 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:01.043152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:01.043646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:01.050302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.050766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.051650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.052077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.082879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6ec7ca7a-5b49-4c4b-b27a-bbb1d05aec9f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments/9d09d950-1298-4bf2-8382-1887d0bda175" status: 200 len: 194 microversion: 2.20 time: 0.150247 Jul 28 17:50:01.083446 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 335/674] 10.222.0.89 () {60 vars in 1454 bytes} [Thu Jul 28 17:50:00 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments/9d09d950-1298-4bf2-8382-1887d0bda175 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:50:01.151215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:01.151715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:01.154683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:01.155500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:01.162267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.162713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.163475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.163910 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.243912 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lazy-loading 'services' on Instance uuid b5b7bb8c-4218-4d08-a7d6-9c91343649a8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:01.314652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-485c92c0-6708-4627-a5eb-c99675affa64 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments/9d09d950-1298-4bf2-8382-1887d0bda175" status: 202 len: 0 microversion: 2.20 time: 0.167212 Jul 28 17:50:01.315252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 340/675] 10.222.0.89 () {60 vars in 1457 bytes} [Thu Jul 28 17:50:01 2022] DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments/9d09d950-1298-4bf2-8382-1887d0bda175 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:01.323806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:01.326559 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:01.332815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.333295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.334105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:01.334541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:01.367875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7b36da40-cb95-442a-bf6e-3dd6090e70bd tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047957 Jul 28 17:50:01.368475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 336/676] 10.222.0.89 () {60 vars in 1343 bytes} [Thu Jul 28 17:50:01 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:50:02.382501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:02.384732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:02.391306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:02.391753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:02.392510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:02.392938 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:02.422682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1d6aec70-a360-4370-870d-bbfdf80fe093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Jul 28 17:50:02.423231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 341/677] 10.222.0.89 () {60 vars in 1343 bytes} [Thu Jul 28 17:50:02 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:50:03.435237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:03.437434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:03.444059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.444507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.445295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.445729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.474614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5b4e845c-a107-4c56-aa56-7855386e7843 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043405 Jul 28 17:50:03.475171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 337/678] 10.222.0.89 () {60 vars in 1343 bytes} [Thu Jul 28 17:50:03 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:03.539166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:03.539713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:03.547002 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.547445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.548210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.548635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.574210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:03.654454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bab5027b-8ad9-42e5-98d0-8081b4d09d01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 204 len: 0 microversion: 2.20 time: 0.118621 Jul 28 17:50:03.655240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 342/679] 10.222.0.89 () {60 vars in 1280 bytes} [Thu Jul 28 17:50:03 2022] DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 17:50:03.664745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:03.665383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:03.671586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.672034 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.672812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:03.673322 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:03.804381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:03.813424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:03.814957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:03.816128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-92633f91-c07b-4c85-a09c-ef0987a993fc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.155309 Jul 28 17:50:03.816679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 338/680] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:03 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:04.778015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:04.778588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:04.785551 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.785994 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.786745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.787172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.839803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:04.840406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:04.847948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.848394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.849152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.849608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.868355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lazy-loading 'services' on Instance uuid ef3b9253-025e-4a8d-af04-b8951ed85ae8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:04.942160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-eeb3657a-8178-47cd-bba4-7b5a9472333c tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments/0cf32f5b-1856-4fdf-ae2b-2e3817d873e4" status: 202 len: 0 microversion: 2.1 time: 0.168135 Jul 28 17:50:04.942840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 343/681] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:50:04 2022] DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments/0cf32f5b-1856-4fdf-ae2b-2e3817d873e4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:04.951445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:04.954401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:04.960687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.961137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.961946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:04.962382 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:04.990526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:04.994637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-66fcc2c2-066d-467c-9952-653c23f9168d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Jul 28 17:50:04.995214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 344/682] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:04 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:50:04.998619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:05.000842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:05.002039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-14d75450-f39d-48a6-bcaf-496f6a06384b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.166207 Jul 28 17:50:05.002590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 339/683] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:04 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:06.007681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:06.010132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:06.017131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:06.017606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:06.018365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:06.019064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:06.025303 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:06.025914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:06.033173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:06.034102 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:06.034412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:06.034847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:06.049420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-eff14dc7-2581-4a94-8903-47eb7281d8ea tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Jul 28 17:50:06.050000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 345/684] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:06 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:06.163123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:06.171161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:06.172681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:06.173880 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ef428d24-674d-4ef0-8446-80d4aa4d5e79 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1725 microversion: 2.20 time: 0.152526 Jul 28 17:50:06.174447 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 340/685] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:06 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:07.062101 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:07.064453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:07.072728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.073276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.082282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.082282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.107908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-08eb12f2-a8e8-4764-8905-93fb0c0aba40 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049772 Jul 28 17:50:07.109536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 346/686] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:07 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 17:50:07.195885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:07.196412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:07.199306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:07.200507 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:07.204369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.205122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.205954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.206392 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.214806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.215543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.216866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.218309 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.238937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:07.296006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:07.306287 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:07.311839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:07.314499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1164c0ea-4771-45d7-aa7f-ef651296be00 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1657 microversion: 2.20 time: 0.120717 Jul 28 17:50:07.317233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 347/687] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:07 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1657 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:07.355939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fab092ce-4dc8-4b41-afe6-a02a1bfb86f4 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 204 len: 0 microversion: 2.1 time: 0.164993 Jul 28 17:50:07.356970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 341/688] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:50:07 2022] DELETE /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:07.365615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:07.366918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:07.374088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.374604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.375698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.376569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.456672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-92685b4f-a6ac-467d-9379-ce40f7a1de95 req-4f8b2a37-589a-4550-bf18-cb0974051965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b7bb8c-4218-4d08-a7d6-9c91343649a8", "name": "network-vif-deleted", "tag": "66a4d790-7df0-45de-afec-7d756c561981"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:07.468939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-92685b4f-a6ac-467d-9379-ce40f7a1de95 req-4f8b2a37-589a-4550-bf18-cb0974051965 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:07.470231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-92685b4f-a6ac-467d-9379-ce40f7a1de95 req-4f8b2a37-589a-4550-bf18-cb0974051965 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:07.482288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-92685b4f-a6ac-467d-9379-ce40f7a1de95 req-4f8b2a37-589a-4550-bf18-cb0974051965 service nova] Creating event network-vif-deleted:66a4d790-7df0-45de-afec-7d756c561981 for instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 on hv-cinder-81322 Jul 28 17:50:07.487533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-92685b4f-a6ac-467d-9379-ce40f7a1de95 req-4f8b2a37-589a-4550-bf18-cb0974051965 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109641 Jul 28 17:50:07.488363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 342/689] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:50:07.522168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:07.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bfcae837-17f0-4d8b-bba3-25d826266325 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1687 microversion: 2.1 time: 0.168519 Jul 28 17:50:07.530960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 348/690] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:07 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:08.339730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:08.340563 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:08.348508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:08.349219 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:08.350022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:08.350451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:08.416642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:08.434343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:08.435841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:08.438208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d0b20276-f7c7-4a26-be3d-2a1a505d07dc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1657 microversion: 2.20 time: 0.103228 Jul 28 17:50:08.453805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 343/691] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:08 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1657 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:08.551810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:08.552548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:08.559272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:08.559722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:08.560494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:08.560926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:08.700963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:08.710959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6d41d15a-d1ef-42d7-a8cd-c201bfb76909 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1687 microversion: 2.1 time: 0.162967 Jul 28 17:50:08.711577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 349/692] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:08 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:09.462976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:09.463610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:09.470850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:09.471547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:09.472325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:09.472765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:09.537268 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:09.545693 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:09.547475 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:09.548637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6d89fd73-015d-4c66-820a-cb7cd1133af9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1657 microversion: 2.20 time: 0.089548 Jul 28 17:50:09.549241 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 344/693] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:09 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:09.731765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:09.732305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:09.738668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:09.739120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:09.739892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:09.740329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:09.877752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:09.885495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4e5ad591-7f5c-4ca5-b2ef-9e3a6eacd77d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1687 microversion: 2.1 time: 0.157599 Jul 28 17:50:09.886078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 350/694] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:09 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:10.571466 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:10.572071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:10.578817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:10.579277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:10.580046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:10.580485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:10.642208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:10.650328 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:10.651833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:10.652968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-edfd0f76-77e8-415c-903c-e111abaf9f0a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1657 microversion: 2.20 time: 0.085401 Jul 28 17:50:10.653557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 345/695] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:10 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:10.907922 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:10.908552 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:10.915127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:10.915568 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:10.916329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:10.916756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:11.050636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:11.058096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bc755bac-73cd-4ad7-aa60-ace38b4dc056 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1687 microversion: 2.1 time: 0.154935 Jul 28 17:50:11.058664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 351/696] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:10 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:11.676544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:11.677139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:11.683760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:11.684200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:11.684956 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:11.685406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:11.750156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:11.758273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:11.759751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:11.760865 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-35b7c340-c3f4-4667-b150-527c514f00bc tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 200 len: 1367 microversion: 2.20 time: 0.088187 Jul 28 17:50:11.761642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 346/697] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:11 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:12.079502 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:12.080156 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:12.086990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:12.087388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:12.088143 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:12.088576 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:12.225604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:12.233061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d5e6972c-c70c-4686-a21b-cd3d83f7031d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1687 microversion: 2.1 time: 0.157596 Jul 28 17:50:12.234785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 352/698] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:12 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:12.785330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:12.786045 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:12.792216 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:12.792672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:12.793480 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:12.793907 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:12.808262 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 HTTP/1.1 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:50:12.810172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:50:12.812384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'b5b7bb8c-4218-4d08-a7d6-9c91343649a8'} Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:12.813393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:50:12.814993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:12.817255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:12.818122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5c189890-7e4c-4972-b339-0fc825e371df tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 404 len: 111 microversion: 2.20 time: 0.038102 Jul 28 17:50:12.818679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 347/699] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:12 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:50:12.827744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c9131b6c-9148-4e1f-acf1-f4803d8010af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '.version_select at 0x7fce3a015430>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:12.859710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c9131b6c-9148-4e1f-acf1-f4803d8010af tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455222813" status: 204 len: 0 microversion: 2.20 time: 0.036395 Jul 28 17:50:12.860315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 353/700] 10.222.0.89 () {60 vars in 1262 bytes} [Thu Jul 28 17:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455222813 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 17:50:13.112544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-0abad059-ff8c-4969-86b6-39a4666e061c req-5d0631c4-4ba6-45b8-93db-8dbdd52f1e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b9253-025e-4a8d-af04-b8951ed85ae8", "name": "network-vif-deleted", "tag": "2c1eff09-7c11-4fd0-b533-bf557da3325f"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:13.126779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-0abad059-ff8c-4969-86b6-39a4666e061c req-5d0631c4-4ba6-45b8-93db-8dbdd52f1e17 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:13.127224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-0abad059-ff8c-4969-86b6-39a4666e061c req-5d0631c4-4ba6-45b8-93db-8dbdd52f1e17 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:13.142616 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-0abad059-ff8c-4969-86b6-39a4666e061c req-5d0631c4-4ba6-45b8-93db-8dbdd52f1e17 service nova] Creating event network-vif-deleted:2c1eff09-7c11-4fd0-b533-bf557da3325f for instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 on hv-cinder-81322 Jul 28 17:50:13.149764 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-0abad059-ff8c-4969-86b6-39a4666e061c req-5d0631c4-4ba6-45b8-93db-8dbdd52f1e17 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Jul 28 17:50:13.151795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 348/701] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:13.256789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:13.258423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:13.269200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:13.270055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:13.271069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:13.271613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:13.292054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:13.323016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:13.323664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:13.324273 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lazy-loading 'fault' on Instance uuid ef3b9253-025e-4a8d-af04-b8951ed85ae8 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:13.396809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:13.407323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1c3a1f87-be8a-486d-97ca-7360995fb2c5 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 200 len: 1334 microversion: 2.1 time: 0.155311 Jul 28 17:50:13.407919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 354/702] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:13 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:13.712392 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5dcdc8b8-3db4-4c2d-9acc-a35e916d9715 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: .version_select at 0x7fce3a736ca0>, body: {"keypair": {"name": "tempest-keypair-712853647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEExHeOrQGavsFDcwSB/k/XBkYFmvR6CIHPcMk3CbOG8pXO0Q7LPhM/EcK5qwoFg0Ikr/wPdGZS6pWUsXmE8eFL3eoqNiN3CRgdhOClD01sG9g2WIFtpiTV7otQ8yGv+kA=="}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:13.729606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-5dcdc8b8-3db4-4c2d-9acc-a35e916d9715 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for project 65535f9817c448dfac997e93efa1a909. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:13.735940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-5dcdc8b8-3db4-4c2d-9acc-a35e916d9715 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for user 0b97c60c0360466fb878e1e9141e1f3e and project 65535f9817c448dfac997e93efa1a909. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:13.765210 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5dcdc8b8-3db4-4c2d-9acc-a35e916d9715 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056987 Jul 28 17:50:13.772339 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 349/703] 10.222.0.89 () {62 vars in 1200 bytes} [Thu Jul 28 17:50:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 17:50:14.427933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:14.428576 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: ef3b9253-025e-4a8d-af04-b8951ed85ae8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:14.435181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:14.435638 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:14.437015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:14.437506 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:14.451304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] HTTP exception thrown: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Request method failure captured: Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 HTTP/1.1 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssD9OJJzzVfPx5S_-itysl29heH3jm_R51nRL0_U21QoHQjQFI_mITdJuD3ZXDjocSXncShXuQtbfpAKwkKvmB9E0hOSOiO5Pgc591kcL0cquikobxlrYwQjVQPZQDslrW6oum9fkIfZs68nFoWSuqPTrNr-eQf14Y66ZdN5hc39_g Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:50:14.453736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_f5332e245b754728b04af219fdb6ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 14327b8153ab4de782d4bcfef7681fc1 Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. Jul 28 17:50:14.455371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'ef3b9253-025e-4a8d-af04-b8951ed85ae8'} Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:14.456184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. Jul 28 17:50:14.457608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:14.458849 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Returning 404 to user: Instance ef3b9253-025e-4a8d-af04-b8951ed85ae8 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:14.458849 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fbbd2494-cb66-4ac2-a226-4e6bab418d84 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8" status: 404 len: 111 microversion: 2.1 time: 0.031207 Jul 28 17:50:14.458849 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 355/704] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:14 2022] GET /compute/v2.1/servers/ef3b9253-025e-4a8d-af04-b8951ed85ae8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:50:14.464357 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fe344cd7-9175-4cba-a9ef-83d2eec7376f tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '.version_select at 0x7fce3a6a0c10>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:14.484650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fe344cd7-9175-4cba-a9ef-83d2eec7376f tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720749023" status: 202 len: 0 microversion: 2.1 time: 0.024077 Jul 28 17:50:14.485165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 350/705] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720749023 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:15.104440 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-291367270", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f60734d5-8026-4cb9-8d4b-31a05ecd50e4"}], "security_groups": [{"name": "tempest-securitygroup--1024231445"}], "key_name": "tempest-keypair-712853647", "user_data": "}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:15.212580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] validate_networks() for [('f60734d5-8026-4cb9-8d4b-31a05ecd50e4', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:50:15.851620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:50:15.852203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:50:15.852500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:50:15.852905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:50:15.853358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:50:15.863339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:15.863818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:15.864664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:15.865103 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:15.881746 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for project 65535f9817c448dfac997e93efa1a909. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:15.885746 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Getting quotas for user 0b97c60c0360466fb878e1e9141e1f3e and project 65535f9817c448dfac997e93efa1a909. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:15.897334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:50:15.899595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:50:15.945121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2665782f-f834-48d0-ade4-c1a55883bc13 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.844965 Jul 28 17:50:15.945794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 356/706] 10.222.0.89 () {62 vars in 1188 bytes} [Thu Jul 28 17:50:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 17:50:15.958379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:15.959908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:16.022038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:16.030968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:16.032511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:16.033699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-54aa1404-ae68-47f7-8810-0e866929bc08 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1280 microversion: 2.20 time: 0.080968 Jul 28 17:50:16.034319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 351/707] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:15 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:17.057450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:17.058083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:17.065680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.066153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.066989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.067469 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.130794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:17.140467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:17.142176 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:17.143554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d2b83613-bfa5-41e4-9f63-96e4ab171312 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1340 microversion: 2.20 time: 0.090566 Jul 28 17:50:17.144389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 357/708] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:17 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:17.418651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:17.419133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:17.426034 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.426488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.427259 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.427693 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.453930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:17.536388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-56aa7efb-91e3-49f3-977d-31b2e9a45b13 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 204 len: 0 microversion: 2.1 time: 0.121171 Jul 28 17:50:17.536977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 352/709] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:50:17 2022] DELETE /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:17.545783 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:17.547518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:17.554262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.554714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.555537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:17.555982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:17.689680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:17.697762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6a95a121-63a8-4cd1-a861-e35afb03cd82 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1507 microversion: 2.1 time: 0.156396 Jul 28 17:50:17.698332 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 358/710] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:17 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:18.007140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:18.010256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:18.020296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.020296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.020296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.020296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.024514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:18.055173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0897484e-ae8e-4ceb-9e3e-400123b8237c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052655 Jul 28 17:50:18.055751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 353/711] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:18 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:50:18.121231 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:18.121730 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:18.128252 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.128699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.129493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.129926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.157201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:18.167074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:18.167900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:18.175277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.175836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.176690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.177225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.240407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b681ef68-5ee8-4d27-8974-d4e3ff927e95 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 204 len: 0 microversion: 2.1 time: 0.122691 Jul 28 17:50:18.241304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 359/712] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:50:18 2022] DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:18.250051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:18.250745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:18.256565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.257019 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.257823 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.258259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.312938 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:18.321078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:18.322598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:18.323707 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2d0cd8e4-adf9-4d54-aa81-6a0d9f37b135 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.160439 Jul 28 17:50:18.324261 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 354/713] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:18 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:18.393541 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:18.401267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5a31fe0d-d7d8-4d2d-9298-73046ffac788 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1672 microversion: 2.1 time: 0.155331 Jul 28 17:50:18.401825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 360/714] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:18 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:18.719633 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:18.720250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:18.726846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.727297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.728065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:18.728528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:18.858627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:18.866055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ff975061-68a0-4c32-bb2c-556b431a5321 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1507 microversion: 2.1 time: 0.150945 Jul 28 17:50:18.866631 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 355/715] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:18 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:19.347599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:19.348209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:19.354996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.355442 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.356209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.356680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.425627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:19.426398 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:19.435343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.435795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.437941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.438228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.508619 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:19.518022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:19.519811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:19.520960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2bc3c481-547d-4b89-bcda-432c6b9eeb22 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.177809 Jul 28 17:50:19.521701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 361/716] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:19 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:19.660501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:19.668457 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e7a05f5d-1408-4da2-afcd-eca6d6dd2c06 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1672 microversion: 2.1 time: 0.248795 Jul 28 17:50:19.669142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 356/717] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:19 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:19.735330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-83ca5718-f895-4de3-b184-d6e0a4279ca7 req-35e43d87-4c93-4e17-88de-c8957550a1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:19.744924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-83ca5718-f895-4de3-b184-d6e0a4279ca7 req-35e43d87-4c93-4e17-88de-c8957550a1a2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.745400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-83ca5718-f895-4de3-b184-d6e0a4279ca7 req-35e43d87-4c93-4e17-88de-c8957550a1a2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.762908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-83ca5718-f895-4de3-b184-d6e0a4279ca7 req-35e43d87-4c93-4e17-88de-c8957550a1a2 service nova] Creating event network-changed:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:50:19.767809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-83ca5718-f895-4de3-b184-d6e0a4279ca7 req-35e43d87-4c93-4e17-88de-c8957550a1a2 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Jul 28 17:50:19.768413 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 362/718] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:19.887094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:19.887731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:19.895345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.895797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:19.896570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:19.897014 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:20.034078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:20.041476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-59bec9f9-21b0-474c-a961-9a1b1c2b3c8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1507 microversion: 2.1 time: 0.158239 Jul 28 17:50:20.042037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 357/719] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:19 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:20.546486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:20.547361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:20.553383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:20.553838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:20.554602 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:20.555036 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:20.687308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:20.691023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:20.691723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:20.695443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:20.697048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:20.697967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:20.698242 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ee83fb73-9a54-4955-849f-1107a570da95 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.157224 Jul 28 17:50:20.698421 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:20.698811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 363/720] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:20 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:20.699196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:20.699683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:21.063091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:21.063729 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:21.069960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:21.070409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:21.071213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:21.071649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:21.269827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:21.278118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-736c9442-0b75-424a-b90e-1112a5b60f8d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1507 microversion: 2.1 time: 0.219232 Jul 28 17:50:21.278805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 364/721] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:21 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:21.439516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:21.447936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-aecebf1c-2744-4b15-9023-3c40b3bc5dc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1672 microversion: 2.1 time: 0.761274 Jul 28 17:50:21.448518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 358/722] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:20 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1672 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:21.721029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:21.721750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:21.728344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:21.728792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:21.729624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:21.730059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:21.870371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:21.880044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:21.881887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:21.883168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6a915151-1720-4a60-9025-647e26fa6cac tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.166034 Jul 28 17:50:21.899883 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 365/723] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:21 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:22.290248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-58f09dce-65e2-4c43-bc19-07cdd68dcfaf req-8a89b78a-b0d8-4309-8e15-8b2a295ea580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0a7816-0379-49a1-acae-959a72fa36b8", "name": "network-vif-deleted", "tag": "320b8217-84b0-4579-b2de-291315cf5fe9"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:22.301293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-58f09dce-65e2-4c43-bc19-07cdd68dcfaf req-8a89b78a-b0d8-4309-8e15-8b2a295ea580 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.302132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-58f09dce-65e2-4c43-bc19-07cdd68dcfaf req-8a89b78a-b0d8-4309-8e15-8b2a295ea580 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.302363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:22.303225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:22.310513 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.311378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.312831 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.313401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.315081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-58f09dce-65e2-4c43-bc19-07cdd68dcfaf req-8a89b78a-b0d8-4309-8e15-8b2a295ea580 service nova] Creating event network-vif-deleted:320b8217-84b0-4579-b2de-291315cf5fe9 for instance 0a0a7816-0379-49a1-acae-959a72fa36b8 on hv-cinder-81322 Jul 28 17:50:22.320335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-58f09dce-65e2-4c43-bc19-07cdd68dcfaf req-8a89b78a-b0d8-4309-8e15-8b2a295ea580 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Jul 28 17:50:22.322103 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 359/724] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:22.414930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:22.425006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-320c2f43-2d4e-40bd-8da0-c253f16caf32 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 200 len: 1465 microversion: 2.1 time: 0.126363 Jul 28 17:50:22.426031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 366/725] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:22 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 1465 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:22.471978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:22.472759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:22.479191 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.479716 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.480562 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.481086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.572422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:22.581121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f1d74630-c059-4676-be8f-6986280affdd tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1604 microversion: 2.1 time: 0.114025 Jul 28 17:50:22.581750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 360/726] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:22 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:22.909869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:22.910493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:22.923642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.924099 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:22.926264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:22.926711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.124585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:23.133217 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:23.134740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:23.135994 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5f4b69eb-5879-4dd1-90f2-ecdc4f41b4ea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.232355 Jul 28 17:50:23.136561 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 367/727] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:22 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:23.446409 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:23.447017 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: 0a0a7816-0379-49a1-acae-959a72fa36b8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:23.454483 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.454968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.455778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.456221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.469919 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] HTTP exception thrown: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Request method failure captured: Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 HTTP/1.1 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssD9OJJzzVfPx5S_-itysl29heH3jm_R51nRL0_U21QoHQjQFI_mITdJuD3ZXDjocSXncShXuQtbfpAKwkKvmB9E0hOSOiO5Pgc591kcL0cquikobxlrYwQjVQPZQDslrW6oum9fkIfZs68nFoWSuqPTrNr-eQf14Y66ZdN5hc39_g Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:50:23.471610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_f5332e245b754728b04af219fdb6ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 14327b8153ab4de782d4bcfef7681fc1 Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. Jul 28 17:50:23.473611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '0a0a7816-0379-49a1-acae-959a72fa36b8'} Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:23.474539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. Jul 28 17:50:23.476024 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:23.477336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Returning 404 to user: Instance 0a0a7816-0379-49a1-acae-959a72fa36b8 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:23.477336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-744090da-7d59-4e82-92c2-32818a93b56d tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8" status: 404 len: 111 microversion: 2.1 time: 0.030506 Jul 28 17:50:23.477336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 361/728] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:23 2022] GET /compute/v2.1/servers/0a0a7816-0379-49a1-acae-959a72fa36b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:50:23.481604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:23.482093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:23.488346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.488776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.489571 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.490009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.517190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:23.595476 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c842f3f6-4c5c-48fc-b8d9-f6b790a89665 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "DELETE /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 204 len: 0 microversion: 2.1 time: 0.117313 Jul 28 17:50:23.596061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 368/729] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:50:23 2022] DELETE /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:23.603749 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:23.604238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:23.604363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:23.604939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:23.610474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.610925 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.611405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.611698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.611857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.612130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.612627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.613067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.634581 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:23.650249 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:23.650708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:23.651163 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'fault' on Instance uuid 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:23.702152 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:23.711224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4278b783-d81b-4a1b-a6b1-5faeb7636e75 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1326 microversion: 2.1 time: 0.111142 Jul 28 17:50:23.711809 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 362/730] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:23 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:23.763083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:23.771951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2199948d-ccbc-4c9d-827f-6eae7c3701c1 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.171714 Jul 28 17:50:23.772539 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 369/731] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:23 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:24.160514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:24.161125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:24.167258 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.167714 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.168482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.169701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.306357 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:24.321320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:24.322851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:24.323979 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-40781d61-280e-4548-b73d-0ca17eefbd01 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.167485 Jul 28 17:50:24.324543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 363/732] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:24 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:24.341679 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-a5743cd2-e832-4b0e-94a1-f93e0876d5fa req-06c9b166-1d3b-440c-ba99-8627a4760648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f84a7a8-29b0-4dfb-a6dd-11e25f978217", "name": "network-vif-deleted", "tag": "68d3356b-d07b-40b6-8d0a-f9dfbab82c03"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:24.348227 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:24.352627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a5743cd2-e832-4b0e-94a1-f93e0876d5fa req-06c9b166-1d3b-440c-ba99-8627a4760648 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.353085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a5743cd2-e832-4b0e-94a1-f93e0876d5fa req-06c9b166-1d3b-440c-ba99-8627a4760648 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.365277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-a5743cd2-e832-4b0e-94a1-f93e0876d5fa req-06c9b166-1d3b-440c-ba99-8627a4760648 service nova] Creating event network-vif-deleted:68d3356b-d07b-40b6-8d0a-f9dfbab82c03 for instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 on hv-cinder-81322 Jul 28 17:50:24.370127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-a5743cd2-e832-4b0e-94a1-f93e0876d5fa req-06c9b166-1d3b-440c-ba99-8627a4760648 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Jul 28 17:50:24.370706 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 370/733] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:24.733578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:24.734367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:24.743197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.743872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.745091 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.745817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.776914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.777400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.777847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'fault' on Instance uuid 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:24.794508 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:24.795232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:24.802557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.803003 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.803779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:24.804212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:24.821081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:24.833559 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fdae653a-ea9f-47cc-99df-c4a49ef49b98 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1326 microversion: 2.1 time: 0.104212 Jul 28 17:50:24.834425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 364/734] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:24 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:24.933384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:24.941299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2d6c54b9-b3fb-4955-856a-da3bcb31a4cf tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.151307 Jul 28 17:50:24.941862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 371/735] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:24 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:25.347365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:25.347976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:25.354340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.354784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.355546 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.356006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.488968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:25.496859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:25.498403 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:25.500330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b6917bcc-fb60-4a1e-853a-7ea843899e21 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.156969 Jul 28 17:50:25.501223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 365/736] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:25 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:25.855548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:25.856157 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:25.863656 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.864120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.864909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.865376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.881011 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:25.893460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=6 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:25.902718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.903155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.903638 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'fault' on Instance uuid 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:25.950142 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:25.958848 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-26690b1d-7a51-4ad0-8f5c-9c2c6db5361e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 200 len: 1326 microversion: 2.1 time: 0.108116 Jul 28 17:50:25.959599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 372/737] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:25 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:25.962330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:25.962936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:25.971144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.971587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:25.972351 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:25.972784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:26.026745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:26.102309 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:26.109935 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-77c0b2eb-f2d8-4e9d-af15-f72fd1c43196 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1522 microversion: 2.1 time: 0.151361 Jul 28 17:50:26.110496 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 366/738] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:25 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:26.523880 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:26.524491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:26.530606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:26.531061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:26.531839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:26.532276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:26.661255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:26.669237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:26.670763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:26.672530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ca9a2ef2-de76-4042-af95-8ed878d4ef9a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.152549 Jul 28 17:50:26.673094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 373/739] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:26 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:26.979804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:26.980405 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:26.987961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:26.988404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:26.989180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:26.989614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.003999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 HTTP/1.1 Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:50:27.005558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:50:27.007010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '4f84a7a8-29b0-4dfb-a6dd-11e25f978217'} Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:27.007850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:50:27.009077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:50:27.010223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:27.010223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6d0ed413-b45f-4170-ad62-339b45559770 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 404 len: 111 microversion: 2.1 time: 0.031010 Jul 28 17:50:27.010223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 367/740] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:26 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:50:27.016433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2962106c-f52b-490a-9bb6-6d4cfff8a4f9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '.version_select at 0x7fce39ee8820>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:27.036613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2962106c-f52b-490a-9bb6-6d4cfff8a4f9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968461231" status: 202 len: 0 microversion: 2.1 time: 0.024043 Jul 28 17:50:27.037272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 374/741] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968461231 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:27.130897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:27.131507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:27.138089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:27.138547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.139333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:27.139769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.241023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14327b8153ab4de782d4bcfef7681fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5332e245b754728b04af219fdb6ca93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:27.248917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8673100f-242f-418b-8954-26cb68711bb3 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 200 len: 1480 microversion: 2.1 time: 0.121822 Jul 28 17:50:27.254790 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 368/742] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:27 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 1480 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:27.290161 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-e3323014-9b7b-454e-8140-cc5d26a1f242 req-b22f32fc-64d4-4f3c-b1b5-37b33a121391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00daefb-7ad3-4334-8db5-47043d2c2c09", "name": "network-vif-deleted", "tag": "fce94af7-010d-4f2b-9d29-fdfc9ec97409"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:27.302498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e3323014-9b7b-454e-8140-cc5d26a1f242 req-b22f32fc-64d4-4f3c-b1b5-37b33a121391 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:27.303222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e3323014-9b7b-454e-8140-cc5d26a1f242 req-b22f32fc-64d4-4f3c-b1b5-37b33a121391 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.314768 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-e3323014-9b7b-454e-8140-cc5d26a1f242 req-b22f32fc-64d4-4f3c-b1b5-37b33a121391 service nova] Creating event network-vif-deleted:fce94af7-010d-4f2b-9d29-fdfc9ec97409 for instance c00daefb-7ad3-4334-8db5-47043d2c2c09 on hv-cinder-81322 Jul 28 17:50:27.319822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-e3323014-9b7b-454e-8140-cc5d26a1f242 req-b22f32fc-64d4-4f3c-b1b5-37b33a121391 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033472 Jul 28 17:50:27.320422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 375/743] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:27.696376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:27.696947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:27.704076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:27.706802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:27.707463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.708892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:27.709375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:27.717499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4483c1e4-5706-4dab-b947-c3086a7e0095 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: .version_select at 0x7fce39ec3dc0>, body: {"keypair": {"name": "tempest-keypair-783677380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkcW8ZThfNmfCLHnEXCuReOfkOdsqsyFuqOiNHDC3tURSBNCOFqX7hB4NP3SI/+8Hp/LfrJg0zkC7K4rI+Ks6+c0pQjb7Ktn1+neqekCGg5OE4kZcHm7I0YSl86i5t6sw=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:27.734236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-4483c1e4-5706-4dab-b947-c3086a7e0095 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:27.739323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-4483c1e4-5706-4dab-b947-c3086a7e0095 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for user 22479a66b0f34038b144f4def1aa3f43 and project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:27.766653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4483c1e4-5706-4dab-b947-c3086a7e0095 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055633 Jul 28 17:50:27.767254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 376/744] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:50:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:50:27.870160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:27.879292 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:27.881113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:27.882269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e15d019b-c618-43ae-8259-3944b0ba61c9 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.189848 Jul 28 17:50:27.882819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 369/745] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:27 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:28.276216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:28.276940 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] [instance: c00daefb-7ad3-4334-8db5-47043d2c2c09] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:28.284314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.284759 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.285571 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.286009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.300202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] HTTP exception thrown: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Request method failure captured: Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 HTTP/1.1 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssD9OJJzzVfPx5S_-itysl29heH3jm_R51nRL0_U21QoHQjQFI_mITdJuD3ZXDjocSXncShXuQtbfpAKwkKvmB9E0hOSOiO5Pgc591kcL0cquikobxlrYwQjVQPZQDslrW6oum9fkIfZs68nFoWSuqPTrNr-eQf14Y66ZdN5hc39_g Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:50:28.301952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_f5332e245b754728b04af219fdb6ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/f5332e245b754728b04af219fdb6ca93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: f5332e245b754728b04af219fdb6ca93 Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748884089 Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 14327b8153ab4de782d4bcfef7681fc1 Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748884089-project Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. Jul 28 17:50:28.303937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'c00daefb-7ad3-4334-8db5-47043d2c2c09'} Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:28.305237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. Jul 28 17:50:28.306668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:28.308450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] Returning 404 to user: Instance c00daefb-7ad3-4334-8db5-47043d2c2c09 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:28.308450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-db522ef0-4acf-4f12-8fe2-5f8552a49953 tempest-ServerRescueNegativeTestJSON-748884089 tempest-ServerRescueNegativeTestJSON-748884089-project] 10.222.0.89 "GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09" status: 404 len: 111 microversion: 2.1 time: 0.031593 Jul 28 17:50:28.308450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 377/746] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:28 2022] GET /compute/v2.1/servers/c00daefb-7ad3-4334-8db5-47043d2c2c09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:50:28.598361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-6584745b-ebe5-49fc-ac31-5369f9afeda2 req-c29df397-008a-4d72-a543-d384fae05a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "name": "network-vif-plugged", "status": "completed", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:28.610125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6584745b-ebe5-49fc-ac31-5369f9afeda2 req-c29df397-008a-4d72-a543-d384fae05a39 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.610565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6584745b-ebe5-49fc-ac31-5369f9afeda2 req-c29df397-008a-4d72-a543-d384fae05a39 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.630274 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-6584745b-ebe5-49fc-ac31-5369f9afeda2 req-c29df397-008a-4d72-a543-d384fae05a39 service nova] Creating event network-vif-plugged:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:50:28.635439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-6584745b-ebe5-49fc-ac31-5369f9afeda2 req-c29df397-008a-4d72-a543-d384fae05a39 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104963 Jul 28 17:50:28.636059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 370/747] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:28.779635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-896398926"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:28.780081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:28.786525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.787018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.787807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.788246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.906970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:28.907692 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:28.915507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.916225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.917361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:28.917960 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:28.933481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.network.security_group_api [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Removing security group fd1757d9-fef7-412a-9927-038fe9d6bbf2 from port 2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 Jul 28 17:50:29.261362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:29.265733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:29.272209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:29.273797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:29.275588 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-efc46cb5-1808-403f-8973-36f5e59e2699 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1406 microversion: 2.20 time: 0.373118 Jul 28 17:50:29.276345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 371/748] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:28 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:50:29.350999 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8345b3f3-8348-4cd2-b212-13797c35abe9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action" status: 202 len: 0 microversion: 2.1 time: 0.575214 Jul 28 17:50:29.351901 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 378/749] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:50:28 2022] POST /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:29.454497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-2de1b496-ffff-4cee-91e1-defba46059fd req-fdc0ea13-b352-4e49-ae0e-ac45baf224cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:29.465920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-2de1b496-ffff-4cee-91e1-defba46059fd req-fdc0ea13-b352-4e49-ae0e-ac45baf224cf service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:29.466371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-2de1b496-ffff-4cee-91e1-defba46059fd req-fdc0ea13-b352-4e49-ae0e-ac45baf224cf service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:29.485237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-2de1b496-ffff-4cee-91e1-defba46059fd req-fdc0ea13-b352-4e49-ae0e-ac45baf224cf service nova] Creating event network-changed:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:50:29.491244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-2de1b496-ffff-4cee-91e1-defba46059fd req-fdc0ea13-b352-4e49-ae0e-ac45baf224cf service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134905 Jul 28 17:50:29.495873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 372/750] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:30.300480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:30.301224 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:30.308698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:30.312768 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:30.313673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:30.314176 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:30.410055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-540775519", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae8fa151-853f-466c-9398-a2ea0d9328cd"}], "security_groups": [{"name": "tempest-securitygroup--1562711924"}], "key_name": "tempest-keypair-783677380", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:30.568076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] validate_networks() for [('ae8fa151-853f-466c-9398-a2ea0d9328cd', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:50:30.576402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:30.586338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:30.587849 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:30.589122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a2217cd0-c692-476a-9f01-a65568026733 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1598 microversion: 2.20 time: 0.294193 Jul 28 17:50:30.590225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 379/751] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:50:30 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1598 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:50:30.616098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:30.616819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:30.629080 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:30.633708 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:30.635744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:30.636479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:30.738116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c6dd3f6c-235e-4461-9671-3c5a9d34cba3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126575 Jul 28 17:50:30.738725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 380/752] 10.222.0.89 () {60 vars in 1316 bytes} [Thu Jul 28 17:50:30 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:50:31.608064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:31.610368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:31.620627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:31.621264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:31.622352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:31.623244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:31.742339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lazy-loading 'services' on Instance uuid 574a7513-1b6c-4bb8-a8f2-d77593f830d2 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:31.872557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-327e4f24-8af2-4017-b17b-d267e8dec2d9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments/897ba447-c956-4a57-964e-916104e6ca2a" status: 202 len: 0 microversion: 2.1 time: 0.275648 Jul 28 17:50:31.875703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 381/753] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:50:31 2022] DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments/897ba447-c956-4a57-964e-916104e6ca2a => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:31.882057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-5c244499-b372-4b3b-9f09-bc311d50cf48 req-89ae3c74-9d97-4d02-865e-80324cbc69ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:31.905104 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5c244499-b372-4b3b-9f09-bc311d50cf48 req-89ae3c74-9d97-4d02-865e-80324cbc69ff service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:31.906911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5c244499-b372-4b3b-9f09-bc311d50cf48 req-89ae3c74-9d97-4d02-865e-80324cbc69ff service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:31.936022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-5c244499-b372-4b3b-9f09-bc311d50cf48 req-89ae3c74-9d97-4d02-865e-80324cbc69ff service nova] Creating event network-changed:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:50:31.948491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-5c244499-b372-4b3b-9f09-bc311d50cf48 req-89ae3c74-9d97-4d02-865e-80324cbc69ff service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070951 Jul 28 17:50:31.950388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 382/754] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:31.959792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:31.986589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:31.987334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:50:31.989417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:50:31.992576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:50:31.993248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:50:31.993828 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:50:32.001062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:32.003934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:32.004765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:32.005261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:32.025208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:32.025642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:32.026623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:32.026954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:32.083220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f146530a-1c2c-474b-9afc-caf097d3f321 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131309 Jul 28 17:50:32.086989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 383/755] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:31 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:32.097593 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:32.116920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Getting quotas for user 22479a66b0f34038b144f4def1aa3f43 and project 78a2f25af7784086aadec8dd5a1015dd. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:32.149690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:50:32.155625 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:50:32.241549 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b44b9056-3f50-43cf-b21b-abaa96d8beac tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.836948 Jul 28 17:50:32.242940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 373/756] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:50:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 17:50:32.255530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d8292fac-41ff-45ac-9369-4ed2b1ef8449 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:32.256171 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d8292fac-41ff-45ac-9369-4ed2b1ef8449 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:32.407832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d8292fac-41ff-45ac-9369-4ed2b1ef8449 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:32.416568 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d8292fac-41ff-45ac-9369-4ed2b1ef8449 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1236 microversion: 2.1 time: 0.166741 Jul 28 17:50:32.432394 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 384/757] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:32 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:33.100799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:33.103352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:33.116146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.116928 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.117976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.119458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.162758 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cd914b08-7c1b-429c-9363-8cde4737d667 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067080 Jul 28 17:50:33.171010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 374/758] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:50:33 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 17:50:33.175964 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:33.176516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:33.196904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.197398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.198192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.198804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.342459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] HTTP exception thrown: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 is not attached to volume 897ba447-c956-4a57-964e-916104e6ca2a Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Request method failure captured: Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments/897ba447-c956-4a57-964e-916104e6ca2a HTTP/1.1 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sugvu835_RWj9IzajiGzGs7C-ACEmDjeKgprhgVtmz1QEbDT-Hfv0GW8oWKUgt6HcundRjt3O54n5rQPYQyl5Q8Ko-WRuJTmCR9w_pl13MCb59Hyw27paax5r47eIalZB1rpDDSPFdZuam_h02JuaIuwfTKiHGUm_NHLEamPs-Y14M Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 0513cb18c0cd43d5a4784f573bb382d4 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:50:33.345483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 0513cb18c0cd43d5a4784f573bb382d4 Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-TestMinimumBasicScenario-586890623-project Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ccc41bad96884148a0088cc8048a2316 Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-TestMinimumBasicScenario-586890623-project Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:50:33.347055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 is not attached to volume 897ba447-c956-4a57-964e-916104e6ca2a Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'server_id': '574a7513-1b6c-4bb8-a8f2-d77593f830d2', 'id': '897ba447-c956-4a57-964e-916104e6ca2a'} Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 897ba447-c956-4a57-964e-916104e6ca2a. Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:33.347737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 is not attached to volume 897ba447-c956-4a57-964e-916104e6ca2a Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 is not attached to volume 897ba447-c956-4a57-964e-916104e6ca2a Jul 28 17:50:33.348882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:33.353635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Returning 404 to user: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 is not attached to volume 897ba447-c956-4a57-964e-916104e6ca2a {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:33.354896 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d96042d2-3e65-4ad2-ba3b-61f546a70ad4 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments/897ba447-c956-4a57-964e-916104e6ca2a" status: 404 len: 154 microversion: 2.1 time: 0.183752 Jul 28 17:50:33.356022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 385/759] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:50:33 2022] DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2/os-volume_attachments/897ba447-c956-4a57-964e-916104e6ca2a => generated 154 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:50:33.458226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:33.458854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:33.477442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.478178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.490171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:33.491473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:33.593411 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:33.601698 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4822d0a4-fde4-4598-ba58-e2de5284233e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1288 microversion: 2.1 time: 0.166957 Jul 28 17:50:33.602271 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 375/760] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:33 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1288 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:34.148564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-fcb6649b-642e-4441-841f-81b8ff9e7c83 req-2440df2f-e15e-402c-9e64-c81818aef38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:34.159236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-fcb6649b-642e-4441-841f-81b8ff9e7c83 req-2440df2f-e15e-402c-9e64-c81818aef38d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.159685 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-fcb6649b-642e-4441-841f-81b8ff9e7c83 req-2440df2f-e15e-402c-9e64-c81818aef38d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.188931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-fcb6649b-642e-4441-841f-81b8ff9e7c83 req-2440df2f-e15e-402c-9e64-c81818aef38d service nova] Creating event network-changed:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:50:34.194562 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-fcb6649b-642e-4441-841f-81b8ff9e7c83 req-2440df2f-e15e-402c-9e64-c81818aef38d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050250 Jul 28 17:50:34.195750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 386/761] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:34.582494 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:34.583924 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:34.596406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.602255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.604468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.609531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.625425 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:34.627315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:34.654482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.663681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.665053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.666776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.681388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:50:34.867536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-70b1ffe5-261b-402d-ab30-33129eae856c tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 204 len: 0 microversion: 2.1 time: 0.289526 Jul 28 17:50:34.872915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 376/762] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:50:34 2022] DELETE /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:50:34.881033 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:34.881801 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:34.888178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.888830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.889646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:34.891228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:34.899404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:34.909891 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-97e857f1-2c26-49dd-8d44-8e61020c6312 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1294 microversion: 2.1 time: 0.289469 Jul 28 17:50:34.910897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 387/763] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:34 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1294 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:35.110604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:35.119137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d1ae5c0f-dd66-428c-b286-239965dcf3b9 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1554 microversion: 2.1 time: 0.244646 Jul 28 17:50:35.119731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 377/764] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:34 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:35.932693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:35.933410 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:35.940276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:35.940791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:35.941591 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:35.942020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:36.104804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:36.112698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dd719c56-c3d8-4cbf-a99c-a1e1dd8f1eec tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.183599 Jul 28 17:50:36.113302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 388/765] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:35 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:36.139736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:36.141042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:36.148379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:36.148822 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:36.149611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:36.150038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:36.285101 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:36.293284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d2d377e8-8f4d-4e0a-b4b5-cba3d114c219 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1554 microversion: 2.1 time: 0.157388 Jul 28 17:50:36.293870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 378/766] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:36 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:37.135850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:37.137522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:37.148916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:37.149775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:37.150764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:37.151416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:37.323408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:37.324757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:37.340511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:37.341400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:37.343788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:37.345300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:37.528870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:37.538123 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3b1006a9-66a1-4f96-9fff-710d032b74e6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.407744 Jul 28 17:50:37.552736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 389/767] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:37 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:37.870799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:37.879742 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d7d975ba-b789-4ff2-8775-7325b927d137 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1554 microversion: 2.1 time: 0.568559 Jul 28 17:50:37.885228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 379/768] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:37 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1554 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:38.323062 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-ecd9b5bc-ee8f-4abe-ae96-6212941d3b5d req-a171302f-533b-4aad-bf00-2544a9afa1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc28eb23-0865-40b3-8263-3a20b158342b", "tag": "5da6905b-247d-4a28-a5b6-247d05430ecb"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:38.355391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-ecd9b5bc-ee8f-4abe-ae96-6212941d3b5d req-a171302f-533b-4aad-bf00-2544a9afa1d2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.357289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-ecd9b5bc-ee8f-4abe-ae96-6212941d3b5d req-a171302f-533b-4aad-bf00-2544a9afa1d2 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.381599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-ecd9b5bc-ee8f-4abe-ae96-6212941d3b5d req-a171302f-533b-4aad-bf00-2544a9afa1d2 service nova] Creating event network-changed:5da6905b-247d-4a28-a5b6-247d05430ecb for instance fc28eb23-0865-40b3-8263-3a20b158342b on hv-cinder-81322 Jul 28 17:50:38.399302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-ecd9b5bc-ee8f-4abe-ae96-6212941d3b5d req-a171302f-533b-4aad-bf00-2544a9afa1d2 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080281 Jul 28 17:50:38.400221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 390/769] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:38.560639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:38.561248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:38.574022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.574786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.575917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.576513 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.846288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:38.854144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a6bd09ba-7e85-4dc2-928e-a830d02a2bf6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.297781 Jul 28 17:50:38.855054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 380/770] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:38 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:38.915876 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:38.916600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:38.923785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.924291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.925246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.925692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.963966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:38.964620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:38.965260 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lazy-loading 'fault' on Instance uuid 574a7513-1b6c-4bb8-a8f2-d77593f830d2 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:50:39.059619 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc41bad96884148a0088cc8048a2316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0513cb18c0cd43d5a4784f573bb382d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:39.069616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4645ac18-0658-4e2d-8ce6-8e06328d5864 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 200 len: 1348 microversion: 2.1 time: 0.162922 Jul 28 17:50:39.072196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 391/771] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:38 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 1348 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:39.878337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:39.879028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:39.886089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:39.886891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:39.887837 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:39.888428 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:40.052755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:40.063112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4e8c59a6-101b-4465-8fb7-dcda0b7626a8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.188860 Jul 28 17:50:40.069749 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 381/772] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:39 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:40.096047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:40.096679 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] [instance: 574a7513-1b6c-4bb8-a8f2-d77593f830d2] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:40.105840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:40.106912 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:40.108744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:40.109450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:40.130225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] HTTP exception thrown: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Request method failure captured: Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 HTTP/1.1 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sugvu835_RWj9IzajiGzGs7C-ACEmDjeKgprhgVtmz1QEbDT-Hfv0GW8oWKUgt6HcundRjt3O54n5rQPYQyl5Q8Ko-WRuJTmCR9w_pl13MCb59Hyw27paax5r47eIalZB1rpDDSPFdZuam_h02JuaIuwfTKiHGUm_NHLEamPs-Y14M Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 0513cb18c0cd43d5a4784f573bb382d4 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:50:40.132505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0513cb18c0cd43d5a4784f573bb382d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 0513cb18c0cd43d5a4784f573bb382d4 Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-TestMinimumBasicScenario-586890623 Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-TestMinimumBasicScenario-586890623-project Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: ccc41bad96884148a0088cc8048a2316 Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-TestMinimumBasicScenario-586890623-project Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. Jul 28 17:50:40.134118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '574a7513-1b6c-4bb8-a8f2-d77593f830d2'} Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:50:40.135017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. Jul 28 17:50:40.136475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:50:40.139347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Returning 404 to user: Instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:50:40.141725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2bdb2b16-21b3-4547-9d1f-faaa2f7f2894 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2" status: 404 len: 111 microversion: 2.1 time: 0.049758 Jul 28 17:50:40.146305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 392/773] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:40 2022] GET /compute/v2.1/servers/574a7513-1b6c-4bb8-a8f2-d77593f830d2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:50:40.151296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e69f4924-e960-49ce-a765-05e74f0199c0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] Calling method '.version_select at 0x7fce3a65dee0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:40.175251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e69f4924-e960-49ce-a765-05e74f0199c0 tempest-TestMinimumBasicScenario-586890623 tempest-TestMinimumBasicScenario-586890623-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774897156" status: 202 len: 0 microversion: 2.1 time: 0.027474 Jul 28 17:50:40.176353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 382/774] 10.222.0.89 () {58 vars in 1269 bytes} [Thu Jul 28 17:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774897156 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:50:40.424701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-eb81be68-ff61-4747-993c-5ac037354a23 req-ec0b93ae-cdca-45c9-b430-5ecb6ce1e3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a7513-1b6c-4bb8-a8f2-d77593f830d2", "name": "network-vif-deleted", "tag": "2c9ee1b3-3b2e-44d5-9666-5c62225b2b18"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:40.439209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-eb81be68-ff61-4747-993c-5ac037354a23 req-ec0b93ae-cdca-45c9-b430-5ecb6ce1e3ce service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:40.439650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-eb81be68-ff61-4747-993c-5ac037354a23 req-ec0b93ae-cdca-45c9-b430-5ecb6ce1e3ce service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:40.471570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:40.473785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-eb81be68-ff61-4747-993c-5ac037354a23 req-ec0b93ae-cdca-45c9-b430-5ecb6ce1e3ce service nova] Creating event network-vif-deleted:2c9ee1b3-3b2e-44d5-9666-5c62225b2b18 for instance 574a7513-1b6c-4bb8-a8f2-d77593f830d2 on hv-cinder-81322 Jul 28 17:50:40.491394 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-eb81be68-ff61-4747-993c-5ac037354a23 req-ec0b93ae-cdca-45c9-b430-5ecb6ce1e3ce service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071166 Jul 28 17:50:40.492318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 393/775] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:41.092708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:41.094849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:41.104243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:41.105021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:41.106476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:41.107418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:41.462104 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:41.470626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-afcdba98-5518-4b35-8221-c7600781e415 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.390805 Jul 28 17:50:41.471358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 383/776] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:41 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:41.597959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c5a976d8-beeb-40f8-b8cd-81e2b58a8c28 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: .version_select at 0x7fce3a080b80>, body: {"keypair": {"name": "tempest-keypair-602287880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoGjhLqchd7skLHY/mSlbZ6TNeP+PtL619LrFdOVr387USm+fb5MI8hco5SgvN3CWkTSlDqpHEJQNY7PtA2PD92fOkdsnUQ4BhEKhkzD12/99Y9m0JK8ek1/qGIkpMovQ=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:41.615482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-c5a976d8-beeb-40f8-b8cd-81e2b58a8c28 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:41.619910 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-c5a976d8-beeb-40f8-b8cd-81e2b58a8c28 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:41.645770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c5a976d8-beeb-40f8-b8cd-81e2b58a8c28 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192058 Jul 28 17:50:41.646860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 394/777] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:50:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:50:42.492276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:42.492883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:42.496035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:42.497347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:42.510309 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:42.510759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:42.511550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:42.511986 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:42.880391 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:42.897065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-69dd9ad8-93e9-4f12-a1ac-677c3dfa0031 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.408511 Jul 28 17:50:42.899255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 384/778] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:42 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:43.329333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-614978443", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c7de1cf-fa0f-482c-9686-4fc41e18afb7"}], "security_groups": [{"name": "tempest-securitygroup--1891878737"}], "key_name": "tempest-keypair-602287880", "user_data": "}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:43.451942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] validate_networks() for [('4c7de1cf-fa0f-482c-9686-4fc41e18afb7', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:50:43.914018 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:50:43.914452 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:50:43.914928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:50:43.915555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:50:43.915750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:50:43.920072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:43.920914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:43.929992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:43.930535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:43.931614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:43.932279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:43.940548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:43.941002 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:43.941838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:43.942278 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:43.973567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:50:43.987942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:50:44.022742 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:50:44.026357 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:50:44.114770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e3db2abd-265e-4296-9eb9-fb0c1e743da4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.790743 Jul 28 17:50:44.115634 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 395/779] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:50:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:50:44.127641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-52cb503b-79d6-4ba5-9c68-e65161d77525 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:44.135519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-52cb503b-79d6-4ba5-9c68-e65161d77525 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:44.214105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:44.225419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e85a656e-93ae-426c-aba9-065bd2a8541e tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.310148 Jul 28 17:50:44.226210 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 385/780] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:43 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:44.248653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-52cb503b-79d6-4ba5-9c68-e65161d77525 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:44.257339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-52cb503b-79d6-4ba5-9c68-e65161d77525 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1240 microversion: 2.1 time: 0.134179 Jul 28 17:50:44.274835 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 396/781] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:44 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:44.839439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-424ab11a-5f39-4183-ac0c-b50bcd9bb7fc req-f16d03aa-1cb0-4948-bf1a-2136c0fc4804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc28eb23-0865-40b3-8263-3a20b158342b", "name": "network-vif-plugged", "status": "completed", "tag": "5da6905b-247d-4a28-a5b6-247d05430ecb"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:44.861146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-424ab11a-5f39-4183-ac0c-b50bcd9bb7fc req-f16d03aa-1cb0-4948-bf1a-2136c0fc4804 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:44.861964 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-424ab11a-5f39-4183-ac0c-b50bcd9bb7fc req-f16d03aa-1cb0-4948-bf1a-2136c0fc4804 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:44.876638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-424ab11a-5f39-4183-ac0c-b50bcd9bb7fc req-f16d03aa-1cb0-4948-bf1a-2136c0fc4804 service nova] Creating event network-vif-plugged:5da6905b-247d-4a28-a5b6-247d05430ecb for instance fc28eb23-0865-40b3-8263-3a20b158342b on hv-cinder-81322 Jul 28 17:50:44.884431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-424ab11a-5f39-4183-ac0c-b50bcd9bb7fc req-f16d03aa-1cb0-4948-bf1a-2136c0fc4804 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053695 Jul 28 17:50:44.885271 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 386/782] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:45.252190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:45.252805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:45.256375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:45.260318 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:45.260766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:45.261767 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:45.262366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:45.302406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:45.303166 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:45.317460 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:45.323977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:45.328467 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:45.329861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:45.490484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:45.499294 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8af13750-5091-41e1-a7e0-c44fe17107e5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1292 microversion: 2.1 time: 0.209388 Jul 28 17:50:45.504025 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 387/783] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:45 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1292 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:50:45.752107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:45.774404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e9a0ee84-da93-423e-abe7-66893cfb70cc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1362 microversion: 2.1 time: 0.528150 Jul 28 17:50:45.775290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 397/784] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:45 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:46.523338 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:46.524540 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:46.540672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:46.541280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:46.542585 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:46.543302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:46.707769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:46.732954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1afbd6c5-a5ae-42e3-9524-efad382e97a7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1298 microversion: 2.1 time: 0.212952 Jul 28 17:50:46.747159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 388/785] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:46 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:46.798254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:46.798819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:46.806290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:46.806737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:46.807521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:46.808280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:46.966792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:46.975560 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c707e826-9ed7-405b-85a0-ab684a3b2d8f tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1547 microversion: 2.1 time: 0.182698 Jul 28 17:50:46.977288 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 398/786] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:46 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:46.997961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:46.998766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:47.013919 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:47.014620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:47.015838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:47.016620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:47.146518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a9309d25-952c-4bba-bc7d-7005d93a1b03 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152458 Jul 28 17:50:47.147166 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 389/787] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:50:46 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:47.754191 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:47.755096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:47.761440 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:47.762241 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:47.763031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:47.763652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:48.008251 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:48.016330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9ae51720-cfe3-4120-9e1a-1eb332d04b38 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.266157 Jul 28 17:50:48.016914 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 399/788] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:47 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:48.552954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-dd716b18-c453-4004-a7c0-5bbef2bc9fef req-a0ea1b44-9229-4ecf-90aa-ae01eff6c09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc28eb23-0865-40b3-8263-3a20b158342b", "tag": "5da6905b-247d-4a28-a5b6-247d05430ecb"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:48.576969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-dd716b18-c453-4004-a7c0-5bbef2bc9fef req-a0ea1b44-9229-4ecf-90aa-ae01eff6c09b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:48.577401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-dd716b18-c453-4004-a7c0-5bbef2bc9fef req-a0ea1b44-9229-4ecf-90aa-ae01eff6c09b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:48.581961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:48.599419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-dd716b18-c453-4004-a7c0-5bbef2bc9fef req-a0ea1b44-9229-4ecf-90aa-ae01eff6c09b service nova] Creating event network-changed:5da6905b-247d-4a28-a5b6-247d05430ecb for instance fc28eb23-0865-40b3-8263-3a20b158342b on hv-cinder-81322 Jul 28 17:50:48.620833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-dd716b18-c453-4004-a7c0-5bbef2bc9fef req-a0ea1b44-9229-4ecf-90aa-ae01eff6c09b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078328 Jul 28 17:50:48.632067 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 390/789] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:49.045612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:49.050122 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:49.061281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:49.062763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:49.064188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:49.064892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:49.232896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-36ae08b3-7fcc-4509-9b7e-72864409e281 req-6636433e-b812-43f6-9df8-ec35ec947c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db521d28-6a27-47cd-b764-156c113ed677", "tag": "51d2b649-6b93-48cc-8e60-2002ccf154a4"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:49.251977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-36ae08b3-7fcc-4509-9b7e-72864409e281 req-6636433e-b812-43f6-9df8-ec35ec947c62 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:49.255657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-36ae08b3-7fcc-4509-9b7e-72864409e281 req-6636433e-b812-43f6-9df8-ec35ec947c62 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:49.299701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-36ae08b3-7fcc-4509-9b7e-72864409e281 req-6636433e-b812-43f6-9df8-ec35ec947c62 service nova] Creating event network-changed:51d2b649-6b93-48cc-8e60-2002ccf154a4 for instance db521d28-6a27-47cd-b764-156c113ed677 on hv-cinder-81322 Jul 28 17:50:49.322887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-36ae08b3-7fcc-4509-9b7e-72864409e281 req-6636433e-b812-43f6-9df8-ec35ec947c62 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094131 Jul 28 17:50:49.324780 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:49.329659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 391/790] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:50:49.336795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ec48ac21-a692-45d7-8efe-404a63fd5436 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.297683 Jul 28 17:50:49.351827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 400/791] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:49 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:50.362596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:50.363297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:50.369817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:50.370264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:50.371042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:50.371473 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:50.692471 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:50.701038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a092f944-11c7-42ca-bef7-6e50f7f7c96f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.343852 Jul 28 17:50:50.717065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 392/792] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:50 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:51.723580 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:51.724194 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:51.731637 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:51.732088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:51.732976 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:51.733697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:51.927293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:51.934907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1e3f543d-37dc-42e3-bdde-51518df4c050 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.216633 Jul 28 17:50:51.935484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 401/793] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:51 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:52.956644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:52.957362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:52.964216 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:52.964668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:52.965476 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:52.965922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:53.102550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:53.110241 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1c7bccbf-2a7d-4f3c-81ce-e5cbc56c99c7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.157996 Jul 28 17:50:53.110821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 393/794] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:52 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:54.131307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:54.131864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:54.134156 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:54.139864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:54.140402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:54.141221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:54.141660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:54.256705 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=18 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:54.275944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:54.284065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-34c2e1bb-8b2c-4049-b496-2e5632fc9569 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.156695 Jul 28 17:50:54.284639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 402/795] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:54 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:54.589547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-9ce3fb0b-eb85-4150-8f55-6f9bce903cba req-20b97bbf-0aef-490a-b821-c558b84da16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db521d28-6a27-47cd-b764-156c113ed677", "name": "network-vif-plugged", "status": "completed", "tag": "51d2b649-6b93-48cc-8e60-2002ccf154a4"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:54.600182 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-9ce3fb0b-eb85-4150-8f55-6f9bce903cba req-20b97bbf-0aef-490a-b821-c558b84da16a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:54.600637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-9ce3fb0b-eb85-4150-8f55-6f9bce903cba req-20b97bbf-0aef-490a-b821-c558b84da16a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:54.611972 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-9ce3fb0b-eb85-4150-8f55-6f9bce903cba req-20b97bbf-0aef-490a-b821-c558b84da16a service nova] Creating event network-vif-plugged:51d2b649-6b93-48cc-8e60-2002ccf154a4 for instance db521d28-6a27-47cd-b764-156c113ed677 on hv-cinder-81322 Jul 28 17:50:54.616760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-9ce3fb0b-eb85-4150-8f55-6f9bce903cba req-20b97bbf-0aef-490a-b821-c558b84da16a service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Jul 28 17:50:54.617455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 394/796] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:55.305451 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:55.306055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:55.312901 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:55.313388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:55.314152 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:55.314579 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:55.446321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:55.454657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0603ed93-5e16-4b43-a4a8-2a3368dec937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.153042 Jul 28 17:50:55.455262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 403/797] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:55 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:56.477144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:56.477858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:56.484250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:56.485873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:56.486652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:56.487083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:56.626008 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:56.633744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4d5ec355-37b9-44d5-9a31-9fc3a04cdace tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1366 microversion: 2.1 time: 0.161367 Jul 28 17:50:56.634314 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 395/798] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:56 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:57.655738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:57.656766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:57.662860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:57.663307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:57.664064 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:57.664495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:57.795065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:50:57.803452 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-806db5fb-1eca-42b1-8d0e-cb43c6fbc741 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1556 microversion: 2.1 time: 0.151599 Jul 28 17:50:57.804026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 404/799] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:50:57 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:50:57.823936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:50:57.824504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:50:57.826942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:57.832729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:57.833199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:57.833985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:57.834422 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:57.914765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f66a54d3-d2df-4fd3-845b-b49653c2b938 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094735 Jul 28 17:50:57.915367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 396/800] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:50:57 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:50:58.845830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-85216885-2ee6-410d-bc2a-f90b14fb5db5 req-ddf76a63-7e1c-4125-bcd3-ebcd21a81113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db521d28-6a27-47cd-b764-156c113ed677", "tag": "51d2b649-6b93-48cc-8e60-2002ccf154a4"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:50:58.856057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-85216885-2ee6-410d-bc2a-f90b14fb5db5 req-ddf76a63-7e1c-4125-bcd3-ebcd21a81113 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:50:58.856493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-85216885-2ee6-410d-bc2a-f90b14fb5db5 req-ddf76a63-7e1c-4125-bcd3-ebcd21a81113 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:50:58.868525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-85216885-2ee6-410d-bc2a-f90b14fb5db5 req-ddf76a63-7e1c-4125-bcd3-ebcd21a81113 service nova] Creating event network-changed:51d2b649-6b93-48cc-8e60-2002ccf154a4 for instance db521d28-6a27-47cd-b764-156c113ed677 on hv-cinder-81322 Jul 28 17:50:58.873897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-85216885-2ee6-410d-bc2a-f90b14fb5db5 req-ddf76a63-7e1c-4125-bcd3-ebcd21a81113 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031800 Jul 28 17:50:58.874542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 405/801] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:10.838649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=26 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.839432 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.843507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:10.844697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:10.851592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:10.852078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:10.852835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:10.853289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:10.878961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-02c20632-da5b-4a07-9bf6-29e607e9f919 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/ips" status: 200 len: 151 microversion: 2.20 time: 0.041797 Jul 28 17:51:10.879520 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 397/802] 10.222.0.89 () {60 vars in 1289 bytes} [Thu Jul 28 17:51:10 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:12.997128 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=16 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:12.997916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=52 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:13.003031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:13.003648 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:13.010689 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:13.011130 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:13.011889 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:13.012319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:13.036101 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lazy-loading 'flavor' on Instance uuid 0ce6e951-fa65-433e-af84-80f075da23fa {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:51:13.213836 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4fa50a8d-3b81-4e84-8109-9a3a52e0e6c3 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/action" status: 202 len: 0 microversion: 2.20 time: 0.218232 Jul 28 17:51:13.214723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 406/803] 10.222.0.89 () {62 vars in 1319 bytes} [Thu Jul 28 17:51:12 2022] POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:51:13.223857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:13.224658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:13.231979 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:13.232449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:13.233445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:13.234039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:13.366846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:13.374666 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:13.377223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:13.378380 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-30f9f2c5-7232-4646-ae18-14476704898e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.159253 Jul 28 17:51:13.378932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 398/804] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:13 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:14.403911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:14.404610 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:14.411265 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:14.411718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:14.412484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:14.412920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:14.548731 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:14.556617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:14.558168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:14.559307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0fd5cfad-d0a2-40ed-9b98-7578178615c4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.160256 Jul 28 17:51:14.559904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 407/805] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:14 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:15.584051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:15.584690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:15.591284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:15.591733 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:15.592504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:15.592943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:15.727037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:15.735438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:15.736948 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:15.738141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7d9c3102-4549-4b2c-a53e-6f94ee0907da tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.158034 Jul 28 17:51:15.738704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 399/806] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:15 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:51:16.760844 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:16.761571 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:16.768978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:16.769441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:16.770196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:16.770621 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:16.906166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:16.914178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:16.915667 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:16.916809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-11693f70-53ee-47ba-b582-65aec16101c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.159846 Jul 28 17:51:16.917398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 408/807] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:16 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:17.939878 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:17.940479 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:17.947124 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:17.947568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:17.948329 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:17.948762 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:18.077461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:18.086335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:18.087750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:18.088892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d0b48972-e659-42c0-8f7f-18221fc51d76 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.153011 Jul 28 17:51:18.089490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 400/808] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:17 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:19.112030 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:19.113113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:19.119869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:19.120350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:19.121111 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:19.121572 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:19.249763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:19.257733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:19.259253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:19.260400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aa1cea2f-413b-4c6d-add1-daff09a47701 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.152311 Jul 28 17:51:19.260964 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 409/809] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:19 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:20.284910 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:20.285836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:20.292631 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:20.293076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:20.293871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:20.294304 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:20.424603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:20.433197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:20.434961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:20.436235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-23f379c9-652d-42a9-9833-722cb98629c1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.155743 Jul 28 17:51:20.436882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 401/810] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:20 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:21.461255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:21.461933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:21.468581 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:21.469094 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:21.469880 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:21.470306 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:21.605329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:21.614272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:21.615796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:21.616945 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a37aaf72-9486-45f9-b589-d285e22cf7de tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.160090 Jul 28 17:51:21.617534 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 410/811] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:21 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:22.643642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:22.644251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:22.651207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:22.651646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:22.652410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:22.652836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:22.782533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:22.790414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:22.791913 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:22.793063 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-32c28839-025e-499d-8373-d2175412acda tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.154095 Jul 28 17:51:22.793644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 402/812] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:22 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:23.816646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:23.817380 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:23.824505 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:23.824942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:23.825721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:23.826146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:23.963455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:23.972229 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:23.973841 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:23.975007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a482c89f-2498-4a68-aa3b-07d149ec1287 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.163008 Jul 28 17:51:23.975794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 411/813] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:23 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:24.998090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:24.998685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:25.004989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:25.005456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:25.006211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:25.006644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:25.138505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:25.147163 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:25.148673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:25.149884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1f8abf3e-3424-47ee-801a-8137c892bdca tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.155673 Jul 28 17:51:25.150444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 403/814] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:24 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:26.173180 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:26.173785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:26.180783 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:26.181297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:26.182021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:26.182501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:26.313695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:26.322428 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:26.323962 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:26.325116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8fbaec18-dc5c-4d55-b663-2c62395acb1b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.156396 Jul 28 17:51:26.325707 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 412/815] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:26 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:27.349241 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:27.349793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:27.356310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:27.356757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:27.357554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:27.357987 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:27.645212 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:27.653263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:27.654745 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:27.655884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-05551e7e-eb0e-45f5-84a0-971ed378364e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.310791 Jul 28 17:51:27.656424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 404/816] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:27 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:28.679473 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:28.680085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:28.686671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:28.687120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:28.687883 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:28.688334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:28.819625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:28.827554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:28.829353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:28.830312 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-214fe05a-3dd4-4f10-a2db-67d7c569982b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.154841 Jul 28 17:51:28.830872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 413/817] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:28 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:51:29.854448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:29.855055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:29.862371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:29.862830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:29.863610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:29.864048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:29.996248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:30.004494 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:30.006017 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:30.007157 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-958b3194-0586-4756-9603-c2776b07db54 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.156615 Jul 28 17:51:30.007695 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 405/818] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:29 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:30.230437 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:30.230986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:30.238379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:30.238831 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:30.239597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:30.240033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:30.261776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lazy-loading 'flavor' on Instance uuid eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:51:30.332703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cc5b1aab-adf1-4910-9c11-ed0f10dabd39 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "POST /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd/action" status: 202 len: 0 microversion: 2.1 time: 0.105931 Jul 28 17:51:30.333419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 414/819] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:51:30 2022] POST /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:51:30.341818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:30.342762 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:30.351965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:30.352444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:30.353257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:30.353710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:30.490137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:30.497732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ae5b027f-91f1-4ad9-8de6-b055fbb37f3e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.159940 Jul 28 17:51:30.498286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 406/820] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:30 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:31.030896 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:31.031593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:31.038027 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:31.038440 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:31.039347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:31.039738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:31.321215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:31.329232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:31.331499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:31.332643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2dab0e63-7e54-4471-a56b-74b0e02b8973 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.306059 Jul 28 17:51:31.333214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 415/821] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:31 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:31.518744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:31.519445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:31.526365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:31.526687 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:31.527456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:31.527896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:31.656911 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:31.665107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-87a0eff5-159e-4071-84be-6aba8bb3aed0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.150292 Jul 28 17:51:31.665685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 407/822] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:31 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:32.297820 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:32.298471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:32.305687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.306139 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.306912 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.307414 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.336103 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f4a53ca5-08a7-4e73-9c92-22d68d6d73a5 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/ips" status: 200 len: 145 microversion: 2.1 time: 0.042076 Jul 28 17:51:32.336752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 416/823] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:51:32 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:32.355757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:32.356364 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:32.364299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.365195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.366122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.366856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.634861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:32.645595 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:32.660939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:32.660939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dc5004b3-ca33-42ba-aa45-f40fe4613e25 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.297898 Jul 28 17:51:32.660939 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 408/824] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:32 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:32.690180 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:32.691853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:32.699589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.700148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.701041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:32.701622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:32.841680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:32.850395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-13c15b1f-ac55-4a10-af18-495d15f44c31 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.166939 Jul 28 17:51:32.850965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 417/825] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:32 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:33.673547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:33.674214 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:33.681482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.681940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:33.682717 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.683153 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:33.725942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee6687e7-aae9-42bc-8e09-5e816edc44ee"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:33.728446 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:33.734957 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.735409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:33.736181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.736615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:33.811923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:33.819910 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:33.828432 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:33.829955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:33.831345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-828d44ff-7809-45c5-91e7-2894e37dc280 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.161664 Jul 28 17:51:33.832170 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 409/826] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:33 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:33.872497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:33.873107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:33.880406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.880854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:33.881728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:33.882735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:34.029212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-17253c98-cd76-4a99-98ad-f56d62875821 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307652 Jul 28 17:51:34.029898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 418/827] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:51:33 2022] POST /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:51:34.030072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:34.039406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6327a711-d051-4b86-85ed-c5ebc600e947 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.171642 Jul 28 17:51:34.039976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 410/828] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:33 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:51:34.856248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:34.856872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:34.864829 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:34.865398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:34.866209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:34.866636 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:34.999590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:35.008522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:35.010037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:35.011248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-19fbd76a-1faa-4bdc-bbf5-745772cc70a4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1743 microversion: 2.20 time: 0.159786 Jul 28 17:51:35.011799 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 419/829] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:34 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:51:35.061569 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:35.062165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:35.069853 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:35.070296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:35.071057 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:35.071489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:35.213587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:35.221088 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ae0a6a1a-ca14-48a1-a624-dd1f6d294d61 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.163329 Jul 28 17:51:35.221696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 411/830] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:35 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:36.035592 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:36.036271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:36.042911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:36.043356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:36.044118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:36.044551 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:36.176916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:36.185041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:36.186730 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:36.187996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2affe0a2-a713-4487-88b9-5a5a2cc5b679 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1743 microversion: 2.20 time: 0.156598 Jul 28 17:51:36.188649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 420/831] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:36 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:36.243086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:36.243687 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:36.250209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:36.250647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:36.251404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:36.251831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:36.383269 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:36.391225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f693b3d6-08b6-4dd6-8db0-d8e3feacb78d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.151710 Jul 28 17:51:36.391795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 412/832] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:36 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:36.786232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-37331119-130f-47c1-a0cb-6deb6b0f1e24 req-061558bb-6fc6-4626-b04f-9313c4b654fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "name": "network-vif-plugged", "status": "completed", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:36.797697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-37331119-130f-47c1-a0cb-6deb6b0f1e24 req-061558bb-6fc6-4626-b04f-9313c4b654fd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:36.798148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-37331119-130f-47c1-a0cb-6deb6b0f1e24 req-061558bb-6fc6-4626-b04f-9313c4b654fd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:36.815319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-37331119-130f-47c1-a0cb-6deb6b0f1e24 req-061558bb-6fc6-4626-b04f-9313c4b654fd service nova] Creating event network-vif-plugged:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:51:36.821072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-37331119-130f-47c1-a0cb-6deb6b0f1e24 req-061558bb-6fc6-4626-b04f-9313c4b654fd service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039489 Jul 28 17:51:36.822275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 421/833] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:37.213436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:37.217776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:37.226852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:37.227298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:37.228096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:37.228526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:37.413555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:37.416958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:37.417609 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:37.418786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:37.422178 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:37.423965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:37.426295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:37.426718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ec253efa-1e59-4773-8bc7-1c01e1b70810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.217130 Jul 28 17:51:37.426858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:37.427521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:37.428148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:37.435736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 413/834] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:37 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:37.587422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:37.596618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-eeff2752-014a-42e3-a449-f3c2028cc61e tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.187187 Jul 28 17:51:37.598307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 422/835] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:37 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:38.454358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:38.454976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:38.462418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:38.463096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:38.463871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:38.464311 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:38.602835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:38.612244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:38.614171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:38.615645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6b63a985-0769-453b-84c8-6416d68a882d tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.165215 Jul 28 17:51:38.616417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 414/836] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:38 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:38.619662 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:38.620274 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:38.632081 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:38.632514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:38.634530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:38.635324 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:38.783193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:38.791211 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6c6dc0bc-1282-4f6a-a973-6296d5076ee0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.175709 Jul 28 17:51:38.791886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 423/837] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:38 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:39.639312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:39.639853 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:39.648087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:39.648519 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:39.649527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:39.649934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:39.810372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:39.813488 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:39.816754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:39.823435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:39.825823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:39.827247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f7406e9d-84b4-4824-802c-e33b1e738a92 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.191869 Jul 28 17:51:39.828399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 415/838] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:39 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:39.835649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:39.836110 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:39.836909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:39.840195 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:39.999426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:40.008735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-717c30dc-5b68-4548-9d7f-4839781ed647 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.199345 Jul 28 17:51:40.009571 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 424/839] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:39 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:51:40.854389 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:40.855621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:40.858134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=39 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:40.865843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:40.866293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:40.867120 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:40.867550 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:41.014580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:41.031652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:41.032266 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:41.038646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:41.042514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:41.044366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:41.046683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-08a08129-3f71-4091-9c7e-9fe53b7c7b77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.195982 Jul 28 17:51:41.047732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:41.048833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:41.054658 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:41.063965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 416/840] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:40 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:41.238713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:41.247727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2f04717e-f38e-42f7-8096-fa1326aceb66 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.219842 Jul 28 17:51:41.248305 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 425/841] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:41 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:42.074283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:42.075003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:42.082785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.083360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.084215 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.084724 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.228132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:42.242706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:42.244642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:42.245888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4956cfae-bd73-4183-9c78-3fe30c6d9810 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.175634 Jul 28 17:51:42.246766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 417/842] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:42 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:42.271841 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:42.272875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:42.282073 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.283603 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.284972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.285496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.432371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:42.440246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f41e8b0d-877e-4134-8013-9bb4952b6562 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.172143 Jul 28 17:51:42.453185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 426/843] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:42 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:42.716164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:42.718709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:42.725609 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.726069 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.726886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.727319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.760319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5bff3cd8-7af4-4b18-bb67-2e1600d5aacf tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050461 Jul 28 17:51:42.766160 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 418/844] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:51:42 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:42.772226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:42.772723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:42.779433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.780035 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.780822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:42.781484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:42.817074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e8374f47-0ca9-4114-93ff-b5ea571cd33c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee" status: 200 len: 194 microversion: 2.1 time: 0.049514 Jul 28 17:51:42.817715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 427/845] 10.222.0.89 () {58 vars in 1413 bytes} [Thu Jul 28 17:51:42 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:43.172134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:43.172629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:43.183637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.184334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.185228 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.185737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.214121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fafd6313-1b33-4275-b453-25074f9f1843 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/ips" status: 200 len: 150 microversion: 2.1 time: 0.045565 Jul 28 17:51:43.214949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 419/846] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:51:43 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:43.272375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:43.273232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:43.281530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=45 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:43.284204 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.285360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.286676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.287217 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.451004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:43.462270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:43.463741 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:43.470227 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:43.471753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:43.474213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5e9f0195-436c-4c7c-b6fc-d4aeec0b2139 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.208919 Jul 28 17:51:43.482585 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.483750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.487382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:43.488359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:43.489477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 428/847] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:43 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:43.707905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:43.717431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-314e54d7-27b8-4f7e-8329-362682c43c69 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.258831 Jul 28 17:51:43.725445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 420/848] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:43 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:44.206192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81f67120-514a-46e0-99fc-191b2126ccb6"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:44.209319 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:44.215963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.216490 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.217597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.218029 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.498616 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:44.499225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:44.508352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.509417 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.511274 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.512028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.588447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6d9860be-e2f4-45a6-8c36-47571eddd121 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "POST /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386077 Jul 28 17:51:44.594201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 429/849] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:51:44 2022] POST /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:44.712836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:44.721426 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:44.723955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:44.725492 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a3ef64c6-1a12-4922-8acd-02d813458375 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.231170 Jul 28 17:51:44.737332 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 421/850] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:44 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:51:44.744772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:44.746352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:44.747911 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0491fdb-b588-4aa5-b7a5-ba27ca1bf540"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:44.750352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:44.757022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.757340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.758279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.758513 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.758909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.759280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.760137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.760671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.938168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:44.947159 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-14d26395-2a27-4985-a6a1-d4b2b08ff124 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1569 microversion: 2.1 time: 0.207530 Jul 28 17:51:44.947733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 430/851] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:44 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:44.970346 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:44.971155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:44.978310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.978841 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:44.979681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:44.980202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:45.013952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124515) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 17:51:45.112091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d2b78675-fd2c-46dc-9826-ae2edf503369 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "POST /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd/action" status: 202 len: 0 microversion: 2.1 time: 0.142651 Jul 28 17:51:45.116192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 431/852] 10.222.0.89 () {60 vars in 1278 bytes} [Thu Jul 28 17:51:44 2022] POST /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:51:45.126613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:45.128222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:45.137402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:45.137931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:45.138773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:45.139314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:45.181369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:45.338880 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:45.358030 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5a3a4284-375b-4bd8-9872-b876aa26bcdb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1517 microversion: 2.1 time: 0.239767 Jul 28 17:51:45.358979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 432/853] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:45 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:45.400633 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c9aa4b18-e456-4653-8476-79ddda7a7e93 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656471 Jul 28 17:51:45.401267 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 422/854] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:51:44 2022] POST /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:45.750376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:45.751004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:45.759006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:45.760015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:45.760995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:45.761613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:45.947277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:45.957818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:45.959432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:45.960698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-547bfb3c-87a9-4b91-9b9a-6f1805904f41 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.214501 Jul 28 17:51:45.961369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 433/855] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:45 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:46.388457 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:46.389183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:46.396037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:46.396583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:46.397858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:46.398469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:46.547386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:46.559917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-38d2c9d4-4e18-4eee-8ab4-82e42cd0b3d4 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.176114 Jul 28 17:51:46.560591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 423/856] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:46 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:46.807773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-d58f82b2-b6d4-4e04-9f44-ebc32807eba5 req-20304f7a-3a7f-47ae-ac9d-724e51c26f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "name": "network-vif-unplugged", "status": "completed", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:46.818496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-d58f82b2-b6d4-4e04-9f44-ebc32807eba5 req-20304f7a-3a7f-47ae-ac9d-724e51c26f69 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:46.819722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-d58f82b2-b6d4-4e04-9f44-ebc32807eba5 req-20304f7a-3a7f-47ae-ac9d-724e51c26f69 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:46.831776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.compute.server_external_events [req-d58f82b2-b6d4-4e04-9f44-ebc32807eba5 req-20304f7a-3a7f-47ae-ac9d-724e51c26f69 service nova] Unable to find a host for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd. Dropping event network-vif-unplugged {{(pid=124515) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 17:51:46.832892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-d58f82b2-b6d4-4e04-9f44-ebc32807eba5 req-20304f7a-3a7f-47ae-ac9d-724e51c26f69 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028606 Jul 28 17:51:46.833477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 434/857] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 17:51:46.984095 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:46.984737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:46.991923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:46.992375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:46.993172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:46.993613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:47.123878 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:47.133542 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:47.135163 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:47.136438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-58dfd67d-2df0-4e4a-a6ed-5721438067aa tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1738 microversion: 2.20 time: 0.156308 Jul 28 17:51:47.137022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 424/858] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:46 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:47.588725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:47.589988 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:47.599716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:47.600407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:47.601615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:47.602302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:47.743975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:47.751622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-187d4022-cc5b-4d26-ac99-583907c21664 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.169479 Jul 28 17:51:47.752193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 435/859] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:47 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:48.159783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:48.160785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:48.167349 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:48.167797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:48.168772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:48.169239 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:48.309090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:48.317118 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:48.318821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:48.319973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-039aea57-d7f8-4cd4-8403-2789017b759b tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1720 microversion: 2.20 time: 0.164172 Jul 28 17:51:48.320522 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 425/860] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:48 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:48.773510 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:48.774111 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:48.780781 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:48.781258 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:48.782039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:48.782477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:48.915979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:48.923494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e2eb3228-dc87-41ec-af3f-dccb55279a8b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.155039 Jul 28 17:51:48.924050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 436/861] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:48 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:49.343138 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:49.343785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:49.350381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:49.350830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:49.351594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:49.352029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:49.482244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:49.491301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:49.492802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:49.493980 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0aa856b4-06ae-40e0-ab89-eb52608b06e7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1720 microversion: 2.20 time: 0.154775 Jul 28 17:51:49.494538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 426/862] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:49 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:49.945493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:49.946098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:49.952972 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:49.953450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:49.954215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:49.954688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.094408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:50.103113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-93684e96-983f-4f1a-937c-395fafe6a940 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.162054 Jul 28 17:51:50.103682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 437/863] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:49 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:50.516674 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:50.517333 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:50.525661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:50.526172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.527009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:50.527471 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.662331 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:50.670273 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:50.671780 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:50.672937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ba50ed84-cf85-41f0-80f7-c9a0530c9037 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1663 microversion: 2.20 time: 0.160223 Jul 28 17:51:50.673572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 427/864] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:50 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:50.696419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b63e19d5-3513-4ac0-8cad-6458cde94720"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:50.698844 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:50.704763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:50.705239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.705989 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:50.706438 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.863904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-c76e1bc8-0480-4959-be09-b13b8373cde6 req-1a7d70cd-6385-4ae1-b62e-291c6ee85dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "name": "network-vif-unplugged", "status": "completed", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:50.874852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c76e1bc8-0480-4959-be09-b13b8373cde6 req-1a7d70cd-6385-4ae1-b62e-291c6ee85dfe service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:50.875380 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c76e1bc8-0480-4959-be09-b13b8373cde6 req-1a7d70cd-6385-4ae1-b62e-291c6ee85dfe service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:50.888442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.compute.server_external_events [req-c76e1bc8-0480-4959-be09-b13b8373cde6 req-1a7d70cd-6385-4ae1-b62e-291c6ee85dfe service nova] Unable to find a host for instance 0ce6e951-fa65-433e-af84-80f075da23fa. Dropping event network-vif-unplugged {{(pid=124516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 17:51:50.889350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-c76e1bc8-0480-4959-be09-b13b8373cde6 req-1a7d70cd-6385-4ae1-b62e-291c6ee85dfe service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029424 Jul 28 17:51:50.890236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 428/865] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 17:51:51.016496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-676422ba-2f68-44c2-bc82-94c878dd65d7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324522 Jul 28 17:51:51.017149 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 438/866] 10.222.0.89 () {62 vars in 1364 bytes} [Thu Jul 28 17:51:50 2022] POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:51.125728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:51.126558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:51.133365 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.133819 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.134678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.136315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.139842 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:51.140364 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:51.147468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.147931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.148714 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.149150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.283562 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:51.291270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cba07f54-6fc5-4b0d-9eab-c9cff0f788ff tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.169658 Jul 28 17:51:51.291846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 429/867] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:51 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:51.405293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d0ed0b69-0a92-42ee-8bec-ae2746a09484 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments/b63e19d5-3513-4ac0-8cad-6458cde94720" status: 202 len: 0 microversion: 2.20 time: 0.269283 Jul 28 17:51:51.405871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 439/868] 10.222.0.89 () {60 vars in 1457 bytes} [Thu Jul 28 17:51:51 2022] DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments/b63e19d5-3513-4ac0-8cad-6458cde94720 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 17:51:51.466820 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:51:51.467419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:51.473526 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.473981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.474755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.475204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.479004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:51.521732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124516) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 17:51:51.589810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f1293dce-9758-4cd5-9d76-5ca5aeadbbaf tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/action" status: 202 len: 0 microversion: 2.20 time: 0.126858 Jul 28 17:51:51.590335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 430/869] 10.222.0.89 () {62 vars in 1319 bytes} [Thu Jul 28 17:51:51 2022] POST /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:51:51.598334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:51.599125 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:51.605265 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.605711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.606480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:51.606905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:51.777072 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:51.785323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:51.787405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:51.788563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-92e03943-601d-4a2b-9e0d-f3629a93492e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1671 microversion: 2.20 time: 0.194123 Jul 28 17:51:51.789119 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 440/870] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:51 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:52.246817 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:52.249029 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:52.256306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.256831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.257747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.258249 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.291032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4dbc52ef-2396-44e7-8b58-8eadc9b962bc tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048242 Jul 28 17:51:52.291592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 431/871] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:51:52 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:51:52.313984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:52.314529 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:52.321819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.322271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.323255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.323732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.435362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:52.435984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:52.442443 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.442923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.443702 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.444144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.463098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:52.470846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a328c2c2-be24-4df0-b746-bbee34a5766d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.160787 Jul 28 17:51:52.471525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 441/872] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:52 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:52.472843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6274ceee-17ce-48f1-8ee0-4c4f110fe979 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee" status: 200 len: 194 microversion: 2.1 time: 0.041376 Jul 28 17:51:52.474107 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 432/873] 10.222.0.89 () {58 vars in 1413 bytes} [Thu Jul 28 17:51:52 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:51:52.484327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:52.484816 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:52.491787 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.492230 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.493004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.493455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.577757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'services' on Instance uuid fc28eb23-0865-40b3-8263-3a20b158342b {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:51:52.653384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cedfd629-9647-4404-92da-17b2510939d9 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee" status: 202 len: 0 microversion: 2.1 time: 0.172505 Jul 28 17:51:52.654275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 442/874] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:51:52 2022] DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/ee6687e7-aae9-42bc-8e09-5e816edc44ee => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:51:52.812051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:52.819675 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:52.826615 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.836383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:52.837250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:52.837689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:53.070054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:53.078104 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:53.079597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:53.080758 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4086bc21-82c3-4130-acf6-a4e437ad4126 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.272678 Jul 28 17:51:53.081409 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 433/875] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:52 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:53.493357 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:53.494088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:53.500259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:53.500712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:53.501517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:53.501963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:53.634729 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:53.642301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b3b9c42b-a5aa-496b-b08e-1e09e6e295f8 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.153749 Jul 28 17:51:53.642873 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 443/876] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:53 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:54.111136 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:54.112505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:54.121879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:54.122345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:54.123140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:54.123571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:54.286016 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:54.295423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:54.297075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:54.302183 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6b922c1a-79bd-4d46-a99e-3c52028cc3d0 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.198636 Jul 28 17:51:54.328277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 434/877] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:54 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:54.665313 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:54.666671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:54.675107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:54.675550 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:54.676325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:54.677378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:54.681272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:54.838154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:54.846005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1de52a96-290e-4c2f-b008-15c32e91bf5d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.185985 Jul 28 17:51:54.846675 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 444/878] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:54 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:55.335276 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:55.336025 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:55.342596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:55.343035 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:55.343802 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:55.344235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:55.486972 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:55.497128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:55.498643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:55.499808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ec4dca7f-a0c0-4476-aed6-79b5ee7e8093 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.169091 Jul 28 17:51:55.500364 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 435/879] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:55 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:55.868118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:55.868720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:55.875691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:55.876144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:55.876930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:55.877403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:56.023256 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:56.031823 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e99084a3-aae1-4e5c-88e9-723032ad58bb tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.167721 Jul 28 17:51:56.033220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 445/880] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:55 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:56.525842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:56.526946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:56.533138 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:56.533608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:56.534381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:56.534813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:56.675968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:56.685561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:56.687087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:56.688266 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a3f680d7-5b4d-4a72-9e94-0aa20274b131 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.168326 Jul 28 17:51:56.688833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 436/881] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:56 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:57.059033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:57.062038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:57.074247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:57.075223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:57.076596 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:57.077489 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:57.246015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:57.254250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5b7c055a-5bd5-4784-a7fb-14ba24164103 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.203835 Jul 28 17:51:57.254857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 446/882] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:57 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:51:57.714247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:57.715022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:57.721726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:57.722272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:57.723136 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:57.724205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:57.867485 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:57.876826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:57.878694 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:57.880502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-aa1efa31-a0b4-4752-820a-d2c164665520 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.169601 Jul 28 17:51:57.881072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 437/883] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:57 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:58.277447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:58.278807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:58.285423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:58.286756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:58.288014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:58.288524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:58.434043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:58.442376 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b85f5d56-e581-4b34-8de8-59403ffe0ead tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.169648 Jul 28 17:51:58.443423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 447/884] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:58 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:51:58.906066 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:58.906687 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:58.916969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:58.917429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:58.918214 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:58.918652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:59.068341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:59.076605 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:59.078193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:59.079377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-74dca79c-9b3b-4ef9-a9ae-634fb0e0358a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.177933 Jul 28 17:51:59.080002 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 438/885] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:51:58 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:51:59.471689 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:51:59.472561 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:51:59.479715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:59.480418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:59.481395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:51:59.481991 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:51:59.632411 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:51:59.640454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-09644507-1ae2-4291-a6c0-d4bf02b43350 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.172544 Jul 28 17:51:59.652624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 448/886] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:51:59 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:00.104681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:00.105384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:00.112556 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:00.113108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:00.114081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:00.115646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:00.257630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:00.266057 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:00.267831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:00.269362 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ece1c79f-b45f-4283-b2d1-35c913eebb07 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.169212 Jul 28 17:52:00.270192 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 439/887] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:00 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:00.665140 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:00.666088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:00.673755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:00.674587 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:00.675763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:00.676556 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:01.088131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:01.098106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-21677356-5c6c-44a1-a39e-6499f24fadf6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.436893 Jul 28 17:52:01.098701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 449/888] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:00 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:01.295815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:01.296509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:01.307779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:01.308518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:01.309966 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:01.311175 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:01.466571 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:01.476583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:01.478220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:01.479460 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1377b5a0-e6ee-478c-9463-a75e2bab11c5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.189153 Jul 28 17:52:01.480120 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 440/889] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:01 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:02.119247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:02.119865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:02.126495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:02.126950 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:02.127720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:02.128159 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:02.264315 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:02.272598 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-740abb84-bb7c-47ac-849b-46db7b9bdfb9 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.157338 Jul 28 17:52:02.273481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 450/890] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:02 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:02.503310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:02.503908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:02.511199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:02.511638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:02.512402 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:02.512834 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:02.650731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:02.658657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:02.660106 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:02.661299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fe67e8fa-f143-4118-a197-f6b6c6933ad1 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.161834 Jul 28 17:52:02.661869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 441/891] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:02 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:03.294401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:03.294985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:03.301530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:03.302149 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:03.302731 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:03.303160 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:03.438577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:03.449730 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4a5b5dc8-6cc1-4302-9eaf-434492bf7ea6 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.159059 Jul 28 17:52:03.450322 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 451/892] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:03 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:03.683857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:03.684513 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:03.691502 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:03.692062 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:03.693523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:03.693969 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:03.828949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:03.837940 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:03.839375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:03.840551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c72043b4-8462-4000-9f5c-531c1240dc5c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.160774 Jul 28 17:52:03.841108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 442/893] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:03 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:04.471761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:04.472393 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:04.479740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:04.480301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:04.481522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:04.482224 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:04.619092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:04.626821 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ea984fe1-f3b0-4ce7-8149-5cc5f01731fa tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1519 microversion: 2.1 time: 0.159228 Jul 28 17:52:04.627357 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 452/894] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:04 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:04.764601 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-54b2b1d9-d9cc-4f87-b1ca-cd0fde455fd0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: .version_select at 0x7fce3a6a01f0>, body: {"keypair": {"name": "tempest-keypair-579457859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImVsfuwI2/XcSx/pRuMDo0W8FEAMR12obXMBBOKoaXFWLhxtVewiTycONFylbFpjWp+LS75dHYOdJjzJZeSWQ6WRVYJL5/3+dm6c9qJ/pA6RWbh6dLjtqX4I96LLxOHkw=="}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:04.781264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-54b2b1d9-d9cc-4f87-b1ca-cd0fde455fd0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:52:04.785080 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-54b2b1d9-d9cc-4f87-b1ca-cd0fde455fd0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:52:04.807474 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-54b2b1d9-d9cc-4f87-b1ca-cd0fde455fd0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046622 Jul 28 17:52:04.808122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 443/895] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:52:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:04.864163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:04.864774 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:04.871531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:04.872038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:04.872956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:04.873748 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:05.104421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:05.113898 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:05.116008 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:05.117461 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-03574650-b83e-4ada-9ea4-c0a277a09d77 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.257250 Jul 28 17:52:05.118221 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 453/896] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:04 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:05.649899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:05.650836 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:05.657164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:05.657651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:05.658634 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:05.659255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:05.877472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:05.888965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3760f6b7-bde9-4986-8cca-e80c68b4ee5f tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.243295 Jul 28 17:52:05.890580 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 444/897] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:05 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:06.144418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:06.145183 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:06.152355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.152807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.153612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.154048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.291052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:06.299170 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:06.300697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:06.301916 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-76921999-2dfe-4646-aabb-683c3a2943be tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.161977 Jul 28 17:52:06.302716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 454/898] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:06 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:06.572869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1375345973", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c7de1cf-fa0f-482c-9686-4fc41e18afb7"}], "security_groups": [{"name": "tempest-securitygroup--507351165"}], "key_name": "tempest-keypair-579457859", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:06.696976 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:06.697490 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:06.703477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.703923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.704676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.705106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.734321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d6463cf8-1c9f-44c8-a3c0-33c69c53296a tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/81f67120-514a-46e0-99fc-191b2126ccb6" status: 200 len: 194 microversion: 2.1 time: 0.042048 Jul 28 17:52:06.734907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 455/899] 10.222.0.89 () {58 vars in 1413 bytes} [Thu Jul 28 17:52:06 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/81f67120-514a-46e0-99fc-191b2126ccb6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:52:06.740838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] validate_networks() for [('4c7de1cf-fa0f-482c-9686-4fc41e18afb7', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:52:06.746545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:06.747037 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:06.753192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.753649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.754421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.754852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.862486 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'services' on Instance uuid fc28eb23-0865-40b3-8263-3a20b158342b {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:52:06.947599 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4338136d-77f7-43d0-8b55-af2e24dda5c6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/81f67120-514a-46e0-99fc-191b2126ccb6" status: 202 len: 0 microversion: 2.1 time: 0.204618 Jul 28 17:52:06.948797 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 456/900] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:52:06 2022] DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments/81f67120-514a-46e0-99fc-191b2126ccb6 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:52:06.954276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:06.954994 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:06.962535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.963905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:06.964806 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:06.965259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.120936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:07.134650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-54293d35-0f96-43bc-b3c2-0fc8d43eef43 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.184593 Jul 28 17:52:07.135420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 457/901] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:06 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:07.152762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-0c2bc24b-a3c3-4068-8e5f-52140c46a3e9 req-ef532c48-807e-438c-a02c-5492f3572b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "name": "network-vif-plugged", "status": "completed", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:07.163103 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0c2bc24b-a3c3-4068-8e5f-52140c46a3e9 req-ef532c48-807e-438c-a02c-5492f3572b9c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:07.163469 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0c2bc24b-a3c3-4068-8e5f-52140c46a3e9 req-ef532c48-807e-438c-a02c-5492f3572b9c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.179014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-0c2bc24b-a3c3-4068-8e5f-52140c46a3e9 req-ef532c48-807e-438c-a02c-5492f3572b9c service nova] Creating event network-vif-plugged:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:52:07.184915 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-0c2bc24b-a3c3-4068-8e5f-52140c46a3e9 req-ef532c48-807e-438c-a02c-5492f3572b9c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048231 Jul 28 17:52:07.185727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 458/902] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:07.196204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:52:07.197206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:52:07.197938 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:52:07.198544 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:52:07.199641 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:52:07.211741 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:07.212193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.213004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:07.213481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.230312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:52:07.235077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:52:07.247347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:52:07.249895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:52:07.296908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-56d15430-7ff3-44c1-9dc9-754f28c239ab tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728377 Jul 28 17:52:07.297777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 445/903] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:52:07.310680 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8ec45991-8c2a-4e26-a86e-c2e2bb2935a2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:07.311187 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8ec45991-8c2a-4e26-a86e-c2e2bb2935a2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:07.327786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:07.328694 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:07.338396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:07.338856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.339909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:07.340564 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:07.386717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8ec45991-8c2a-4e26-a86e-c2e2bb2935a2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:07.395070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8ec45991-8c2a-4e26-a86e-c2e2bb2935a2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1241 microversion: 2.1 time: 0.088890 Jul 28 17:52:07.405322 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 459/904] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:07 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:07.503598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:07.512438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:07.513968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:07.515115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-20d1e903-eac4-4189-8400-1419aac02137 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.191938 Jul 28 17:52:07.515685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 446/905] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:07 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:08.156826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:08.157462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:08.165490 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.165942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.166716 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.167155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.296779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:08.305661 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9ff901a5-6f03-47aa-bd72-32106148e6a0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.152739 Jul 28 17:52:08.306423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 460/906] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:08 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:08.416440 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:08.417057 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:08.424320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.424783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.425592 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.426034 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.445774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:08.491936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:08.499604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a32cb553-ce5c-41cc-aa58-f6933b06420e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1237 microversion: 2.1 time: 0.087154 Jul 28 17:52:08.500159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 447/907] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:08 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:08.539959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:08.540565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:08.546765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.547151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.547918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:08.548347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:08.684647 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:08.687007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:08.694952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:08.696472 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:08.697688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bd2c2ea1-6845-4b1b-83b0-bf00fc219eea tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.162419 Jul 28 17:52:08.698247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 461/908] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:08 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:09.194175 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.196575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.202632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.203072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.203843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.204256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.233011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d0eab066-a4fa-402a-88b0-b0bd7f3d5ce7 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043275 Jul 28 17:52:09.233608 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 448/909] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:52:09.327430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.328308 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.349606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.350023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.350158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.350847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.351280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.352299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.358611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.359059 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.359823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.360256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.397647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-df7cae8c-4b8d-455e-8b9f-b939ee36bed1 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051374 Jul 28 17:52:09.404209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 449/910] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 17:52:09.482430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.483610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.487791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:09.492505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.493032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.493900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.494668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.523309 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:52:09.536959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.544700 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4816a77a-6d51-49a6-adf2-364ec01f5ad3 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.221723 Jul 28 17:52:09.545393 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 462/911] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:09.564129 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.565363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.572007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.572484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.573280 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.573747 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.613576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8bab6937-61ac-4be5-b349-7ba25717e23c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 204 len: 0 microversion: 2.1 time: 0.136944 Jul 28 17:52:09.614166 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 450/912] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:52:09 2022] DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:52:09.623972 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.624673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.632511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.633034 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.633850 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.634250 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.642020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.650545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-872642e6-77f2-4f14-b8df-78e94937ffe7 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1301 microversion: 2.1 time: 0.091600 Jul 28 17:52:09.651207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 463/913] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:09.721013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:09.721802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:09.729131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.729857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.730616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:09.731431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:09.791115 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.799378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9398de9a-99b7-4d22-8326-5cd87316147c tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1672 microversion: 2.1 time: 0.179723 Jul 28 17:52:09.799965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 451/914] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:09.888997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.903277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.905422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:09.908870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bf86823f-a9fc-4eaa-b58f-58da6be3d690 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1729 microversion: 2.20 time: 0.191744 Jul 28 17:52:09.909903 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 464/915] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:09 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:52:10.568673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:10.569511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:10.575860 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.576304 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.577069 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.577524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.673107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:10.674185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:10.681251 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.682059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.683056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.683498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.712909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:10.720521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-be9661d5-6fcd-406a-9c50-bbc6fd989487 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.156216 Jul 28 17:52:10.721090 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 452/916] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:10 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:10.747713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:10.755096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-802a8aa7-39f6-456a-923d-f699dcd06ae4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1311 microversion: 2.1 time: 0.085934 Jul 28 17:52:10.756310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 465/917] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:10 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:10.821921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:10.822442 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:10.828622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.829068 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.830382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.830382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.933420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:10.934120 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:10.940266 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.940959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.941828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:10.942344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:10.967855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:10.976382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-926fdbca-6e33-47c4-bc82-b6052c5d7619 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1672 microversion: 2.1 time: 0.159326 Jul 28 17:52:10.977060 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 453/918] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:10 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:11.072788 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:11.080720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:11.082273 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:11.083406 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-02136db7-bf78-4223-8890-fccfc83944a5 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1716 microversion: 2.20 time: 0.154041 Jul 28 17:52:11.083968 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 466/919] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:10 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:52:11.741973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:11.742583 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:11.749208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:11.749659 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:11.750470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:11.750901 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:11.777655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:11.778267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:11.784950 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:11.785437 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:11.786216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:11.786693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:11.857830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:11.866464 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dd69a5f5-b9f4-4021-8605-e6c0735cdbf5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1311 microversion: 2.1 time: 0.093183 Jul 28 17:52:11.867310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 467/920] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:11 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:11.891489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:11.900412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ba5d1b54-eb5e-4588-bebb-fd4946914c55 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.162278 Jul 28 17:52:11.900993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 454/921] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:11 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:12.001770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:12.003428 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:12.011911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.012569 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.013772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.014208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.155981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:12.164204 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3ac896c5-9dd2-43e9-9b1a-ca24ff1afdaa tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1672 microversion: 2.1 time: 0.169427 Jul 28 17:52:12.164779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 468/922] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:11 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:12.887692 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:12.888334 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:12.895523 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.895974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.897180 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.897632 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.921645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:12.922255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:12.930914 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.931395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.932333 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:12.932766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:12.973520 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:12.982712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4569f731-cb46-4fff-bb24-596b20e80fd5 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1299 microversion: 2.1 time: 0.098889 Jul 28 17:52:12.983613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 455/923] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:12 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:13.080102 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:13.088882 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e6004c9a-635d-4908-aa64-8e8367b80137 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.171150 Jul 28 17:52:13.089719 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 469/924] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:12 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:13.186561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:13.187181 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:13.193785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:13.194235 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:13.195022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:13.195456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:13.379428 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:13.389286 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ade3dd33-117d-4700-8589-fb0e835444df tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1672 microversion: 2.1 time: 0.206934 Jul 28 17:52:13.389869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 456/925] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:13 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:14.006531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:14.007150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:14.009699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:14.014936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.015385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.016201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.016600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.111788 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:14.112390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:14.127226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.127919 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.128888 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.129543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.166001 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:14.174481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1bf5f95e-c52a-456f-b2aa-62676c8dc27a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.172109 Jul 28 17:52:14.175060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 470/926] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:14 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:14.411990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:14.413347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:14.419372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.419809 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.420649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.421083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:14.448751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:14.457636 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-90111120-303a-4d05-bf0b-0c268935cce1 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.349127 Jul 28 17:52:14.458220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 457/927] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:14 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:14.562775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:14.572567 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a78d4e14-490b-4a41-8655-cb804e4cfb16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1672 microversion: 2.1 time: 0.164271 Jul 28 17:52:14.573213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 471/928] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:14 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:14.983455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-7f1e5100-53ed-47a3-ab48-032281836e3c req-99427fc5-bd5d-44ed-a542-9ee8dbe9b0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd39380c-a0c4-4d3d-9498-25198768009e", "tag": "1f582e56-d95f-4ee1-99cb-467cbc456249"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:14.993627 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-7f1e5100-53ed-47a3-ab48-032281836e3c req-99427fc5-bd5d-44ed-a542-9ee8dbe9b0e6 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:14.994535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-7f1e5100-53ed-47a3-ab48-032281836e3c req-99427fc5-bd5d-44ed-a542-9ee8dbe9b0e6 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.012789 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-7f1e5100-53ed-47a3-ab48-032281836e3c req-99427fc5-bd5d-44ed-a542-9ee8dbe9b0e6 service nova] Creating event network-changed:1f582e56-d95f-4ee1-99cb-467cbc456249 for instance bd39380c-a0c4-4d3d-9498-25198768009e on hv-cinder-81322 Jul 28 17:52:15.019018 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-7f1e5100-53ed-47a3-ab48-032281836e3c req-99427fc5-bd5d-44ed-a542-9ee8dbe9b0e6 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038570 Jul 28 17:52:15.019879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 458/929] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:15.195695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:15.196385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:15.206405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.207736 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.208612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.213334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.426410 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:15.436509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b3df586e-be7d-4cd5-8962-9239b8532d2c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.244946 Jul 28 17:52:15.437247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 472/930] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:15 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:15.482524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:15.483223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:15.492051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.492597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.493557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.494065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.594164 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:15.594775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:15.602075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.602519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.603296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.603901 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.638704 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:15.639154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:15.639596 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lazy-loading 'fault' on Instance uuid fc28eb23-0865-40b3-8263-3a20b158342b {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:52:15.657937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:15.665949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1efefa7e-d8c8-4ad9-bdfa-8c3920d85a6c tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.188049 Jul 28 17:52:15.667056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 459/931] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:15 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:15.686283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22479a66b0f34038b144f4def1aa3f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a2f25af7784086aadec8dd5a1015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:15.694871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bd8c4c5a-3e38-4df0-8429-8d9cdcb39b16 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 200 len: 1326 microversion: 2.1 time: 0.104400 Jul 28 17:52:15.695531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 473/932] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:15 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:16.459999 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:16.460739 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:16.467034 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.467481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.468247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.468678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.596621 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:16.604053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3fc438cd-1d6d-4b50-a16f-c15ab6f86a5f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.148863 Jul 28 17:52:16.604614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 460/933] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:16 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:16.686918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:16.687559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:16.694866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.695316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.696084 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.696522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.717448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:16.718064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:16.724045 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.724506 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.725381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:16.726572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:16.739709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b HTTP/1.1 Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:52:16.742142 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:16.743833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'fc28eb23-0865-40b3-8263-3a20b158342b'} Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:16.744796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:16.746484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:52:16.747982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:16.747982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9d57ac3d-b624-46b1-87ff-fb2683db8bc6 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 404 len: 111 microversion: 2.1 time: 0.030100 Jul 28 17:52:16.747982 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 461/934] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:16 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:52:16.752312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f6094846-8460-4101-88aa-e156b046b861 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '.version_select at 0x7fce3a746550>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:16.771729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f6094846-8460-4101-88aa-e156b046b861 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783677380" status: 202 len: 0 microversion: 2.1 time: 0.022853 Jul 28 17:52:16.772324 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 462/935] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783677380 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:52:16.881435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:16.889079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d0a9751a-9b5b-4daf-bca5-03486aec82ed tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.206004 Jul 28 17:52:16.891878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 474/936] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:16 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:17.040889 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-1aad3506-96e2-43d6-833a-ceb290ea1027 req-2d8acedb-02c1-40f9-9cd0-96f49f9cc389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc28eb23-0865-40b3-8263-3a20b158342b", "name": "network-vif-deleted", "tag": "5da6905b-247d-4a28-a5b6-247d05430ecb"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:17.051499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-1aad3506-96e2-43d6-833a-ceb290ea1027 req-2d8acedb-02c1-40f9-9cd0-96f49f9cc389 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.052085 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-1aad3506-96e2-43d6-833a-ceb290ea1027 req-2d8acedb-02c1-40f9-9cd0-96f49f9cc389 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:17.063527 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-1aad3506-96e2-43d6-833a-ceb290ea1027 req-2d8acedb-02c1-40f9-9cd0-96f49f9cc389 service nova] Creating event network-vif-deleted:5da6905b-247d-4a28-a5b6-247d05430ecb for instance fc28eb23-0865-40b3-8263-3a20b158342b on hv-cinder-81322 Jul 28 17:52:17.070122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-1aad3506-96e2-43d6-833a-ceb290ea1027 req-2d8acedb-02c1-40f9-9cd0-96f49f9cc389 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034361 Jul 28 17:52:17.070829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 463/937] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:17.144294 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-90e976d9-7c8c-4931-b9dc-e915edfb65b2 req-af6bf133-42f7-46e5-9333-538d3b86c395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "name": "network-vif-plugged", "status": "completed", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:17.157038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-90e976d9-7c8c-4931-b9dc-e915edfb65b2 req-af6bf133-42f7-46e5-9333-538d3b86c395 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.157752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-90e976d9-7c8c-4931-b9dc-e915edfb65b2 req-af6bf133-42f7-46e5-9333-538d3b86c395 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:17.169423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-90e976d9-7c8c-4931-b9dc-e915edfb65b2 req-af6bf133-42f7-46e5-9333-538d3b86c395 service nova] Creating event network-vif-plugged:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:52:17.175044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-90e976d9-7c8c-4931-b9dc-e915edfb65b2 req-af6bf133-42f7-46e5-9333-538d3b86c395 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Jul 28 17:52:17.175856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 475/938] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:17.622516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:17.624088 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=10 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:17.628954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:17.629977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:17.638352 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.639021 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:17.639806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.640383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:17.871696 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:17.879989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-32ebc217-8a0d-4c49-99e7-678a0e13841f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.258439 Jul 28 17:52:17.880565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 464/939] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:17 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:17.908504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:17.914322 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:17.915219 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:17.921747 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.922195 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:17.922963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:17.923397 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:18.070070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:18.077709 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4038f0e4-2671-4ae8-8057-13829a1bd9b2 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1575 microversion: 2.1 time: 0.170105 Jul 28 17:52:18.078279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 476/940] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:17 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:18.902560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:18.903172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:18.909930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:18.910382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:18.911188 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:18.911647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:18.931367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:19.075808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:19.101739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:19.102627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:19.110396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1a6e5959-8426-4eca-a906-b1229c9a277c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.211782 Jul 28 17:52:19.110990 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 465/941] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:18 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:19.115460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:19.115959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:19.116826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:19.117338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:19.268703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:19.277605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5a30d80b-9590-4ac7-82be-9453b064fb78 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1562 microversion: 2.1 time: 0.182730 Jul 28 17:52:19.278190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 477/942] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:19 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:20.131986 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:20.132522 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:20.139673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.140135 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.140904 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.141377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.186667 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:20.187185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:20.193622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.194177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.195216 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.195645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.208979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b HTTP/1.1 Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:52:20.211311 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.212943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'fc28eb23-0865-40b3-8263-3a20b158342b'} Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:20.213839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.215528 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.217351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:20.217351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a221558c-27eb-4189-b333-1bebf132ed8d tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 404 len: 111 microversion: 2.1 time: 0.030034 Jul 28 17:52:20.217351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 478/943] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:52:20 2022] DELETE /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:52:20.220823 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:20.221548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: fc28eb23-0865-40b3-8263-3a20b158342b] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:20.228377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.228824 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.229630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:20.230061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:20.244775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b HTTP/1.1 Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:52:20.246350 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.247925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'fc28eb23-0865-40b3-8263-3a20b158342b'} Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:20.248920 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. Jul 28 17:52:20.250239 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:20.251480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance fc28eb23-0865-40b3-8263-3a20b158342b could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:20.251480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a22bda3e-76d6-4df6-a995-66315db4d81b tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b" status: 404 len: 111 microversion: 2.1 time: 0.030540 Jul 28 17:52:20.251480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 479/944] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:20 2022] GET /compute/v2.1/servers/fc28eb23-0865-40b3-8263-3a20b158342b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:52:20.275245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:20.282984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6dd18477-6f2b-4533-8e38-fa46c282c97d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.155111 Jul 28 17:52:20.283568 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 466/945] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:20 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:21.145181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-5cf9d77b-6e36-4637-b05c-be4fe5d4f964 req-970f943f-228a-4a2b-b67e-8a8ac32c4a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd39380c-a0c4-4d3d-9498-25198768009e", "name": "network-vif-plugged", "status": "completed", "tag": "1f582e56-d95f-4ee1-99cb-467cbc456249"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:21.157409 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5cf9d77b-6e36-4637-b05c-be4fe5d4f964 req-970f943f-228a-4a2b-b67e-8a8ac32c4a03 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.157853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5cf9d77b-6e36-4637-b05c-be4fe5d4f964 req-970f943f-228a-4a2b-b67e-8a8ac32c4a03 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.161864 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=100 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:21.172124 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-5cf9d77b-6e36-4637-b05c-be4fe5d4f964 req-970f943f-228a-4a2b-b67e-8a8ac32c4a03 service nova] Creating event network-vif-plugged:1f582e56-d95f-4ee1-99cb-467cbc456249 for instance bd39380c-a0c4-4d3d-9498-25198768009e on hv-cinder-81322 Jul 28 17:52:21.177017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-5cf9d77b-6e36-4637-b05c-be4fe5d4f964 req-970f943f-228a-4a2b-b67e-8a8ac32c4a03 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Jul 28 17:52:21.177639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 480/946] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:21.305211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:21.306591 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:21.313552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.313997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.314774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.315207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.395530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:21.396118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:21.403281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.403727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.404494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.404925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.418349 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 HTTP/1.1 Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:52:21.420163 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.422046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '4f84a7a8-29b0-4dfb-a6dd-11e25f978217'} Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:21.422934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.424345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.426093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:21.426093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4cd0cdb6-7122-43ee-a141-3eacd6fabbc8 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 404 len: 111 microversion: 2.1 time: 0.030445 Jul 28 17:52:21.426093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 481/947] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:52:21 2022] DELETE /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:52:21.432951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:21.433582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] [instance: 4f84a7a8-29b0-4dfb-a6dd-11e25f978217] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:21.439632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.440079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.440836 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:21.441289 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:21.456371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] HTTP exception thrown: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Request method failure captured: Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 HTTP/1.1 Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssJrpz9b2VTMsBSVYg9mD9tF3HcoiID6RjEDxMA5RsoIj_aTmAl8lE-z36yJ26cQPVz4ga-4uIyI3WCnxVcum3r6a4Q-Z0659SWC1jMLJkpTQLTAkwVeZRmr_rfyeXJemmL8qcovlJXbueNjI06qPOMI4nxVjFSSDr6F95UJ_4Dxdw Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:52:21.457939 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/78a2f25af7784086aadec8dd5a1015dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 78a2f25af7784086aadec8dd5a1015dd Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeTestJSON-111647965 Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 22479a66b0f34038b144f4def1aa3f43 Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeTestJSON-111647965-project Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.460936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '4f84a7a8-29b0-4dfb-a6dd-11e25f978217'} Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:21.462617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. Jul 28 17:52:21.465337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:21.468193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] Returning 404 to user: Instance 4f84a7a8-29b0-4dfb-a6dd-11e25f978217 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:21.468193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-71f8c550-91c9-48d8-bbdc-74577b830411 tempest-AttachVolumeTestJSON-111647965 tempest-AttachVolumeTestJSON-111647965-project] 10.222.0.89 "GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217" status: 404 len: 111 microversion: 2.1 time: 0.032815 Jul 28 17:52:21.468193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 482/948] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:21 2022] GET /compute/v2.1/servers/4f84a7a8-29b0-4dfb-a6dd-11e25f978217 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:52:21.764930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:21.772373 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2bd69a3e-6be3-4690-8613-8ac7a48e24d3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.471021 Jul 28 17:52:21.773004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 467/949] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:21 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:22.794427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:22.795134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:22.801762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:22.802215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:22.802986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:22.803462 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:23.226630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:23.234516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f16463a9-06d5-478d-9acf-ce491b082a6d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1366 microversion: 2.1 time: 0.443911 Jul 28 17:52:23.235103 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 483/950] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:22 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:24.255921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:24.256619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:24.263869 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:24.264325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:24.265344 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:24.265942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:24.415508 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:24.423430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-43936ab6-172f-4fdb-8033-9d09bf1150c3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1557 microversion: 2.1 time: 0.171945 Jul 28 17:52:24.424093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 468/951] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:24 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:24.444320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:24.445482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:24.452316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:24.452767 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:24.453566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:24.456927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:24.577146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f7ad67b8-2965-4349-9be8-e9fc352177c8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136847 Jul 28 17:52:24.577778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 484/952] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:52:24 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:25.769472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-e77ba076-76c7-4931-86bc-17d5c3cc91da req-f76e081a-018a-487a-80d5-f8b37c720eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd39380c-a0c4-4d3d-9498-25198768009e", "tag": "1f582e56-d95f-4ee1-99cb-467cbc456249"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:25.781405 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-e77ba076-76c7-4931-86bc-17d5c3cc91da req-f76e081a-018a-487a-80d5-f8b37c720eed service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:25.781856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-e77ba076-76c7-4931-86bc-17d5c3cc91da req-f76e081a-018a-487a-80d5-f8b37c720eed service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:25.794225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-e77ba076-76c7-4931-86bc-17d5c3cc91da req-f76e081a-018a-487a-80d5-f8b37c720eed service nova] Creating event network-changed:1f582e56-d95f-4ee1-99cb-467cbc456249 for instance bd39380c-a0c4-4d3d-9498-25198768009e on hv-cinder-81322 Jul 28 17:52:25.799988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-e77ba076-76c7-4931-86bc-17d5c3cc91da req-f76e081a-018a-487a-80d5-f8b37c720eed service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035251 Jul 28 17:52:25.800645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 469/953] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:26.859445 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-879c009d-1c9c-453d-9458-b96365270953 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Action: 'create', calling method: .version_select at 0x7fce3a010160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1356067802", "metadata": {"Type": "work"}}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:27.169270 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-879c009d-1c9c-453d-9458-b96365270953 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.492486 Jul 28 17:52:27.169967 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 485/954] 10.222.0.89 () {60 vars in 1156 bytes} [Thu Jul 28 17:52:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 494 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 17:52:27.183302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c908ec86-17dc-4e14-9a0c-f34a34abc5a5 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce3a7363a0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:27.234049 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c908ec86-17dc-4e14-9a0c-f34a34abc5a5 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 200 len: 353 microversion: 2.1 time: 0.055368 Jul 28 17:52:27.234676 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 470/955] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:52:27 2022] GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:28.248768 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-10ad40dd-8629-4129-9216-f45963d2fbe9 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce39f50ca0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:28.297238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-10ad40dd-8629-4129-9216-f45963d2fbe9 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 200 len: 354 microversion: 2.1 time: 0.052832 Jul 28 17:52:28.297800 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 486/956] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:52:28 2022] GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:28.310505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b2b3cae8-d15c-4a87-a33b-5ec5070426b4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce3a7778b0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:28.357786 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b2b3cae8-d15c-4a87-a33b-5ec5070426b4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 200 len: 354 microversion: 2.1 time: 0.051618 Jul 28 17:52:28.358379 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 471/957] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:52:28 2022] GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:28.375466 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3099eaaa-5c1d-40bd-a582-a46689aef50c tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce39ec3550>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:28.438818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3099eaaa-5c1d-40bd-a582-a46689aef50c tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 202 len: 0 microversion: 2.1 time: 0.067124 Jul 28 17:52:28.439382 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 487/958] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:52:28 2022] DELETE /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:52:28.447886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9aebc83f-3b9c-4a33-b1f6-425f5359282f tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce3a76c940>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:28.496675 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9aebc83f-3b9c-4a33-b1f6-425f5359282f tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 200 len: 353 microversion: 2.1 time: 0.053006 Jul 28 17:52:28.497265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 472/959] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:52:28 2022] GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:29.511383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7c365158-3fe5-4f7b-b620-1fad0582cef4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Calling method '.version_select at 0x7fce39ffe160>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:29.539799 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-7c365158-3fe5-4f7b-b620-1fad0582cef4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] HTTP exception thrown: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7c365158-3fe5-4f7b-b620-1fad0582cef4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Request method failure captured: Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 HTTP/1.1 Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sza-aoXE-UEy71tXQ-Nr6S5PwJsgHnvRgFg6AVzxJxniMeOXYSl9gNIODS0CsCQn74fwMj8OlvEYqgu4rkY4G_IA1u-avMV3riNRQNncwAsLGHjS1DkL0WfUpLuXlGAQHk8QbMQtrRejEgbNCN-swH5A-ySxgLscP427Ho22eLWawE Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 41427b4bd1954e39b7788ceb3beeb6ea Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesGetTestJSON-1571163522 Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:52:29.541812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/41427b4bd1954e39b7788ceb3beeb6ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_41427b4bd1954e39b7788ceb3beeb6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/41427b4bd1954e39b7788ceb3beeb6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/41427b4bd1954e39b7788ceb3beeb6ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesGetTestJSON-1571163522 Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 41427b4bd1954e39b7788ceb3beeb6ea Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesGetTestJSON-1571163522 Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesGetTestJSON-1571163522-project Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 281bce48542044b9a781465e7140e9ed Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesGetTestJSON-1571163522-project Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '038e8ae6-05c8-41e0-8851-e81c4ef60ac8'} Jul 28 17:52:29.543284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. (HTTP 404) (Request-ID: req-ab1bd780-b0d9-4338-a830-7f6dcf25bc2b) Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:29.544169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 17:52:29.545654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 17:52:29.547033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7c365158-3fe5-4f7b-b620-1fad0582cef4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] Returning 404 to user: Volume 038e8ae6-05c8-41e0-8851-e81c4ef60ac8 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7c365158-3fe5-4f7b-b620-1fad0582cef4 tempest-VolumesGetTestJSON-1571163522 tempest-VolumesGetTestJSON-1571163522-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8" status: 404 len: 109 microversion: 2.1 time: 0.036765 Jul 28 17:52:29.548465 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 488/960] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:52:29 2022] GET /compute/v2.1/os-volumes/038e8ae6-05c8-41e0-8851-e81c4ef60ac8 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:52:52.123009 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:52.123775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=22 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:52.127810 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-852609166", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "networks": [{"uuid": "b126574d-f0b1-4b3b-a4ad-e9b8498153d0"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:52.181394 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] validate_networks() for [('b126574d-f0b1-4b3b-a4ad-e9b8498153d0', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:52:52.528007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:52:52.528437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:52:52.528915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:52:52.529356 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:52:52.529771 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:52:52.539264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:52.539728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:52.540535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:52.540974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:52.559283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Getting quotas for project 51f7a6e9080d48418e4912be02e09922. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:52:52.563287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Getting quotas for user aedeb9e3e967402aa1458ceedf023dac and project 51f7a6e9080d48418e4912be02e09922. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:52:52.574367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:52:52.576709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:52:52.621495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-40c301c1-fa1f-4db4-868e-7a61d8835688 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499782 Jul 28 17:52:52.622233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 473/961] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:52:52.630530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=31 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:52.631813 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=15 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:52:52.636852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8f40cb84-a938-4c1e-a7e9-1385fe21af55 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:52.637495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8f40cb84-a938-4c1e-a7e9-1385fe21af55 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:52.691883 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8f40cb84-a938-4c1e-a7e9-1385fe21af55 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:52.698712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8f40cb84-a938-4c1e-a7e9-1385fe21af55 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1213 microversion: 2.1 time: 0.069692 Jul 28 17:52:52.699282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 489/962] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:52 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:53.720858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:53.721439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:53.728438 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:53.728882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:53.729665 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:53.730097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:53.793281 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:53.800734 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5ccaf567-2b50-4445-a0e7-50378290c6fe tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1265 microversion: 2.1 time: 0.084533 Jul 28 17:52:53.801317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 474/963] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:53 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:54.822941 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:54.823621 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:54.830804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:54.831175 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:54.832017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:54.832521 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:54.908189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:54.916488 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9753ba4b-59ba-47a8-ae3e-abd87be39ca0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1271 microversion: 2.1 time: 0.098200 Jul 28 17:52:54.917444 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 490/964] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:54 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:55.725532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-ba660f39-9556-45ec-9196-0766e11e5560 req-0152d681-f1f6-4a89-bf19-c4b37a8ddec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7982c2f-7027-4786-8177-0c8ff4883572", "tag": "f7152a51-f407-4347-bb34-1baa556f6701"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:52:55.735424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-ba660f39-9556-45ec-9196-0766e11e5560 req-0152d681-f1f6-4a89-bf19-c4b37a8ddec0 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:55.735871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-ba660f39-9556-45ec-9196-0766e11e5560 req-0152d681-f1f6-4a89-bf19-c4b37a8ddec0 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:55.749887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-ba660f39-9556-45ec-9196-0766e11e5560 req-0152d681-f1f6-4a89-bf19-c4b37a8ddec0 service nova] Creating event network-changed:f7152a51-f407-4347-bb34-1baa556f6701 for instance c7982c2f-7027-4786-8177-0c8ff4883572 on hv-cinder-81322 Jul 28 17:52:55.754689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-ba660f39-9556-45ec-9196-0766e11e5560 req-0152d681-f1f6-4a89-bf19-c4b37a8ddec0 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033665 Jul 28 17:52:55.755293 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 475/965] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:55.937744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:55.938338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:55.946755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:55.947296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:55.948172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:55.948892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:56.081725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:56.089173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1b8f9794-2ae1-4c60-8674-1890460c2dcc tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.155352 Jul 28 17:52:56.089965 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 491/966] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:55 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:57.111815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:57.112431 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:57.119277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:57.119727 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:57.120499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:57.120926 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:57.260372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:57.267839 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dc9a5b84-4288-4973-a302-a075fbb8eb57 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.160817 Jul 28 17:52:57.268408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 476/967] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:57 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:58.291493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:58.292095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:58.298709 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:58.299102 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:58.299860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:58.300296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:58.434778 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:58.442211 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3fd73789-59eb-4050-8037-17cf2dc34a0e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.155140 Jul 28 17:52:58.442901 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 492/968] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:58 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:59.464851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:59.465528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:59.471946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.472391 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.473367 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.473799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.547021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:59.549330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:59.556203 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.556652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.557459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.557897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.588173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1b79ca0b-95b4-4e1e-9ced-ee323a22d424 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045058 Jul 28 17:52:59.588757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 493/969] 10.222.0.89 () {60 vars in 1343 bytes} [Thu Jul 28 17:52:59 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:52:59.616145 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:59.625150 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-808f9a80-4ad8-40f8-a0ea-0846c987d0db tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.164954 Jul 28 17:52:59.625757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 477/970] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:52:59 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:52:59.653705 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:59.654148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:59.660378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.660832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.661627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.662066 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.687944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:52:59.763423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-051ad0dd-cf23-4ba8-8b49-44c9c81c7c1f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 204 len: 0 microversion: 2.20 time: 0.113630 Jul 28 17:52:59.764034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 494/971] 10.222.0.89 () {60 vars in 1280 bytes} [Thu Jul 28 17:52:59 2022] DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 17:52:59.773712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:59.774390 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:52:59.780937 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.781424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.782205 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:59.782643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:59.912524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:59.921317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:59.922833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:52:59.924004 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-81cf8cce-8b55-423c-8a76-98d806650cc7 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.154660 Jul 28 17:52:59.924561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 478/972] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:52:59 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:53:00.647271 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:00.648210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:00.655395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:00.655846 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:00.656617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:00.657054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:00.786113 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:00.793984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e4aa4ba3-511e-4096-9205-961cb07ea680 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.150972 Jul 28 17:53:00.794553 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 495/973] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:00 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:00.948310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:00.948923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:00.955805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:00.956208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:00.956961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:00.957635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:01.094461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:01.103461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:01.105051 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:01.106369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3e4df77c-ead3-4434-aa9f-cb919e7cb380 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.162924 Jul 28 17:53:01.106934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 479/974] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:00 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:53:01.268572 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-412ecb18-f0b3-400a-96f5-1c0c6b194cdf req-cb04e788-10d1-4d39-a44f-04bd03cb0d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7982c2f-7027-4786-8177-0c8ff4883572", "name": "network-vif-plugged", "status": "completed", "tag": "f7152a51-f407-4347-bb34-1baa556f6701"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:01.279332 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-412ecb18-f0b3-400a-96f5-1c0c6b194cdf req-cb04e788-10d1-4d39-a44f-04bd03cb0d04 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:01.279771 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-412ecb18-f0b3-400a-96f5-1c0c6b194cdf req-cb04e788-10d1-4d39-a44f-04bd03cb0d04 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:01.293387 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-412ecb18-f0b3-400a-96f5-1c0c6b194cdf req-cb04e788-10d1-4d39-a44f-04bd03cb0d04 service nova] Creating event network-vif-plugged:f7152a51-f407-4347-bb34-1baa556f6701 for instance c7982c2f-7027-4786-8177-0c8ff4883572 on hv-cinder-81322 Jul 28 17:53:01.298958 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-412ecb18-f0b3-400a-96f5-1c0c6b194cdf req-cb04e788-10d1-4d39-a44f-04bd03cb0d04 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 Jul 28 17:53:01.299568 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 496/975] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:01.815209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:01.815638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:01.822050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:01.822501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:01.823283 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:01.823717 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:02.030936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:02.038517 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-399a64f6-b8d3-4cbc-b525-7cc3bcd7d4c0 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.227352 Jul 28 17:53:02.039247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 480/976] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:01 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:02.130745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:02.131474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:02.142744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:02.142744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:02.142744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:02.142744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:02.277697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:02.285674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:02.287181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:02.288340 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e562b5ae-f145-460d-9d0e-5015c3b6e83a tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1722 microversion: 2.20 time: 0.161901 Jul 28 17:53:02.289671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 497/977] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:02 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:53:02.928851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-dd556d16-3954-42fb-a45e-fce3ed23b61c req-12c8a258-549d-42f3-b160-e361e9c055bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6e951-fa65-433e-af84-80f075da23fa", "name": "network-vif-deleted", "tag": "02dfadbe-faf1-4f78-bb83-5e3e6670bb0c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:02.934497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:02.935166 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:02.942130 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-dd556d16-3954-42fb-a45e-fce3ed23b61c req-12c8a258-549d-42f3-b160-e361e9c055bd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:02.942582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-dd556d16-3954-42fb-a45e-fce3ed23b61c req-12c8a258-549d-42f3-b160-e361e9c055bd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:02.954941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-dd556d16-3954-42fb-a45e-fce3ed23b61c req-12c8a258-549d-42f3-b160-e361e9c055bd service nova] Creating event network-vif-deleted:02dfadbe-faf1-4f78-bb83-5e3e6670bb0c for instance 0ce6e951-fa65-433e-af84-80f075da23fa on hv-cinder-81322 Jul 28 17:53:02.960464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-dd556d16-3954-42fb-a45e-fce3ed23b61c req-12c8a258-549d-42f3-b160-e361e9c055bd service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035252 Jul 28 17:53:02.961064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 481/978] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:03.061038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:03.062009 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:03.064425 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:03.070640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:03.071480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:03.072396 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:03.073091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:03.232385 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:03.248173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1ad8f868-c897-431a-b289-87d80b7efbb2 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1313 microversion: 2.1 time: 0.191071 Jul 28 17:53:03.249000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 498/979] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:03 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:03.312807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:03.313525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:03.320955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:03.322586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:03.323946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:03.324572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:03.358162 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:03.358605 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:03.359255 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lazy-loading 'fault' on Instance uuid 0ce6e951-fa65-433e-af84-80f075da23fa {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:53:03.408793 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:03.417987 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:03.420124 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:03.421314 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6dfee727-4b14-4529-86ad-98969605818e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1370 microversion: 2.20 time: 0.112959 Jul 28 17:53:03.421873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 482/980] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:03 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:53:03.707422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 17:53:03.707867 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 17:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 17:53:04.269657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:04.270345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:04.278168 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:04.278624 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:04.279396 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:04.279832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:04.423051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:04.430698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-12289485-ab80-4dae-a145-3101ccaaaacb tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1497 microversion: 2.1 time: 0.164915 Jul 28 17:53:04.431263 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 499/981] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:04 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:04.443760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:04.444358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:04.451909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:04.452316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:04.453123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:04.453586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:04.486077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:04.486528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:04.487103 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lazy-loading 'fault' on Instance uuid 0ce6e951-fa65-433e-af84-80f075da23fa {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:53:04.528360 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:04.536257 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:04.537783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b97c60c0360466fb878e1e9141e1f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65535f9817c448dfac997e93efa1a909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:04.539371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-90f37e16-56b8-4070-96c1-3e44bcef674c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 200 len: 1370 microversion: 2.20 time: 0.099096 Jul 28 17:53:04.539976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 483/982] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:04 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:53:05.058114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:05.058610 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:05.064796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.065257 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.066105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.066531 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.091543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:53:05.172152 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b44a8e25-31f3-48c6-b687-8cc31fa72909 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "DELETE /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 204 len: 0 microversion: 2.1 time: 0.118158 Jul 28 17:53:05.172737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 500/983] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:53:05 2022] DELETE /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:53:05.182375 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:05.183123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:05.189113 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.189596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.190353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.190784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.318202 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:05.326586 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-07657b69-580f-4dbb-923b-948164c1a6a6 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1503 microversion: 2.1 time: 0.149103 Jul 28 17:53:05.327171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 484/984] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:05 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:05.562954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:05.563573 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:05.570077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.571153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.571932 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:05.572369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:05.585682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa HTTP/1.1 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:05.587447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:05.589351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '0ce6e951-fa65-433e-af84-80f075da23fa'} Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:05.590361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:05.591960 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:05.593557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:05.593557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0bdb96b8-9a3f-43b0-8e2f-1c3a7b562ce2 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 404 len: 111 microversion: 2.20 time: 0.030272 Jul 28 17:53:05.593557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 501/985] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:05 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:05.597815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-836bec19-00c1-4a0e-bb93-d13e7ef40230 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '.version_select at 0x7fce3a777430>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:05.616340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-836bec19-00c1-4a0e-bb93-d13e7ef40230 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712853647" status: 204 len: 0 microversion: 2.20 time: 0.022368 Jul 28 17:53:05.616896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 485/986] 10.222.0.89 () {60 vars in 1259 bytes} [Thu Jul 28 17:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712853647 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 17:53:06.347639 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:06.348255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:06.355581 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:06.356039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:06.356813 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:06.357282 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:06.492513 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:06.500197 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ee91cb58-117b-48b2-9c81-91367e962e65 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1503 microversion: 2.1 time: 0.156382 Jul 28 17:53:06.500775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 502/987] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:06 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:07.412048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:07.412648 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:07.420007 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.420454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.421245 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.421689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.435395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa HTTP/1.1 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:53:07.437036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.438795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '0ce6e951-fa65-433e-af84-80f075da23fa'} Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:07.439759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.441359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.442946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:07.442946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3579b771-b993-4225-9eaa-0eaf50b301e4 tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 404 len: 111 microversion: 2.20 time: 0.030941 Jul 28 17:53:07.442946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 486/988] 10.222.0.89 () {60 vars in 1280 bytes} [Thu Jul 28 17:53:07 2022] DELETE /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:07.451785 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:07.452417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: 0ce6e951-fa65-433e-af84-80f075da23fa] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:07.458891 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.459351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.460107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.460533 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.473845 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa HTTP/1.1 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:07.475339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.477013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '0ce6e951-fa65-433e-af84-80f075da23fa'} Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:07.478608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. Jul 28 17:53:07.480115 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:07.481578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance 0ce6e951-fa65-433e-af84-80f075da23fa could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:07.481578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c0f856da-0fde-4cf5-a836-d8b0d7f7647f tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa" status: 404 len: 111 microversion: 2.20 time: 0.029153 Jul 28 17:53:07.481578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 503/989] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:07 2022] GET /compute/v2.1/servers/0ce6e951-fa65-433e-af84-80f075da23fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:07.522319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:07.523284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:07.530284 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.530882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.531862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:07.532369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:07.784682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:07.792988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fbcb2e5c-dbb2-490c-9a1f-9f88c3bea0fd tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 200 len: 1503 microversion: 2.1 time: 0.274842 Jul 28 17:53:07.793684 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 487/990] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:07 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:08.057474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-db36f623-6aba-45ff-85f2-198862017dff req-8f42d61e-21dc-42ff-b7f9-d0abca6ceed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7982c2f-7027-4786-8177-0c8ff4883572", "name": "network-vif-deleted", "tag": "f7152a51-f407-4347-bb34-1baa556f6701"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:08.067997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-db36f623-6aba-45ff-85f2-198862017dff req-8f42d61e-21dc-42ff-b7f9-d0abca6ceed8 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.068629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-db36f623-6aba-45ff-85f2-198862017dff req-8f42d61e-21dc-42ff-b7f9-d0abca6ceed8 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.080800 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-db36f623-6aba-45ff-85f2-198862017dff req-8f42d61e-21dc-42ff-b7f9-d0abca6ceed8 service nova] Creating event network-vif-deleted:f7152a51-f407-4347-bb34-1baa556f6701 for instance c7982c2f-7027-4786-8177-0c8ff4883572 on hv-cinder-81322 Jul 28 17:53:08.085838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-db36f623-6aba-45ff-85f2-198862017dff req-8f42d61e-21dc-42ff-b7f9-d0abca6ceed8 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Jul 28 17:53:08.089422 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 504/991] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:08.622998 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:08.623541 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:08.631452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.631965 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.633238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.633818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.651321 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 HTTP/1.1 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:53:08.652892 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.654645 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'b5b7bb8c-4218-4d08-a7d6-9c91343649a8'} Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:08.655533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.657122 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.658799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:08.658799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e2a98e53-48b7-49ee-ba04-6a8266844c9c tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 404 len: 111 microversion: 2.20 time: 0.035729 Jul 28 17:53:08.658799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 488/992] 10.222.0.89 () {60 vars in 1280 bytes} [Thu Jul 28 17:53:08 2022] DELETE /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:08.665284 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:08.666600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] [instance: b5b7bb8c-4218-4d08-a7d6-9c91343649a8] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:08.672999 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.673514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.674262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.674701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.688222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] HTTP exception thrown: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Request method failure captured: Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 HTTP/1.1 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4ssLmSfZ6LH-PcSul0zFhL3vLZiuuOqe-6u5SVNkz02xaEUl-wUNOCXrAn5beeQwX9SRzOlDGC692MGWq8o-ZXEYwVjxj-Z60ZNZtQq8EMKJjeinKm1bAKkBY_xVK1U8g5AdCfx1NxaZnQq2A1aE8cnNW5URSasxxWs6S89o9R4OXDk Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:08.689963 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/65535f9817c448dfac997e93efa1a909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_65535f9817c448dfac997e93efa1a909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/65535f9817c448dfac997e93efa1a909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 65535f9817c448dfac997e93efa1a909 Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1999172378 Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 0b97c60c0360466fb878e1e9141e1f3e Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1999172378-project Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.691676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'b5b7bb8c-4218-4d08-a7d6-9c91343649a8'} Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:08.692665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. Jul 28 17:53:08.693995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.695276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] Returning 404 to user: Instance b5b7bb8c-4218-4d08-a7d6-9c91343649a8 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:08.695276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-469dafd8-da5d-4ac7-9113-de7bf1fe7c3e tempest-AttachVolumeShelveTestJSON-1999172378 tempest-AttachVolumeShelveTestJSON-1999172378-project] 10.222.0.89 "GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8" status: 404 len: 111 microversion: 2.20 time: 0.030907 Jul 28 17:53:08.695276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 505/993] 10.222.0.89 () {60 vars in 1277 bytes} [Thu Jul 28 17:53:08 2022] GET /compute/v2.1/servers/b5b7bb8c-4218-4d08-a7d6-9c91343649a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:08.814910 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:08.815891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: c7982c2f-7027-4786-8177-0c8ff4883572] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:08.822747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.823481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.825377 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:08.826434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:08.842920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] HTTP exception thrown: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Request method failure captured: Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 HTTP/1.1 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4szyQyAY9CEZM_7iz0qctHLXwdQJ-TYzmYXbYHNZ6tSq-cREUKs6NmH7kaeqXyFSBTwDDBR4jvbB9F3216THIiUk6B7pceuVrU1SjHLLHBfAerAgiYWHVGFR6kWZ6-vhgPfPHT3wBIFB1MFDFF6RGQkyIgZYiTh1YpSWod0CWYOkKv4 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 51f7a6e9080d48418e4912be02e09922 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-VolumesActionsTest-916486485 Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:53:08.845743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_51f7a6e9080d48418e4912be02e09922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-VolumesActionsTest-916486485 Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 51f7a6e9080d48418e4912be02e09922 Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-VolumesActionsTest-916486485 Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-VolumesActionsTest-916486485-project Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: aedeb9e3e967402aa1458ceedf023dac Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-VolumesActionsTest-916486485-project Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. Jul 28 17:53:08.847238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'c7982c2f-7027-4786-8177-0c8ff4883572'} Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:08.848098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. Jul 28 17:53:08.849732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:08.851011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Returning 404 to user: Instance c7982c2f-7027-4786-8177-0c8ff4883572 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:08.851011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2cd00131-118d-441a-92ee-5fa974883c4c tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572" status: 404 len: 111 microversion: 2.1 time: 0.036523 Jul 28 17:53:08.851011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 489/994] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:08 2022] GET /compute/v2.1/servers/c7982c2f-7027-4786-8177-0c8ff4883572 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:53:08.902671 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-949593182", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "networks": [{"uuid": "b126574d-f0b1-4b3b-a4ad-e9b8498153d0"}]}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:08.958383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] validate_networks() for [('b126574d-f0b1-4b3b-a4ad-e9b8498153d0', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:53:09.800017 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:53:09.800627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:53:09.800887 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:53:09.801330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:53:09.801740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:53:09.816496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:09.816935 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:09.817765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:09.818193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:09.835711 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Getting quotas for project 51f7a6e9080d48418e4912be02e09922. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:53:09.839997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Getting quotas for user aedeb9e3e967402aa1458ceedf023dac and project 51f7a6e9080d48418e4912be02e09922. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:53:09.854177 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:53:09.856479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:53:09.907069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c35488c8-b634-4592-ab73-784473ef30e7 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008894 Jul 28 17:53:09.909307 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 506/995] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:53:09.919114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-59f9a70e-8119-4713-b003-9c17abfc1366 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:09.919726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-59f9a70e-8119-4713-b003-9c17abfc1366 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:09.982138 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-59f9a70e-8119-4713-b003-9c17abfc1366 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:09.990226 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-59f9a70e-8119-4713-b003-9c17abfc1366 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1213 microversion: 2.1 time: 0.075279 Jul 28 17:53:10.004870 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 490/996] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:09 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:11.011998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:11.012802 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:11.020148 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:11.020612 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:11.021427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:11.021870 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:11.042487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:11.119653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:11.128577 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ed56c4d5-cc1c-4b30-85da-60a9c8892561 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1265 microversion: 2.1 time: 0.120825 Jul 28 17:53:11.129875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 507/997] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:11 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:12.154629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:12.155945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:12.168290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.169074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.170098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.170691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.445149 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:12.455495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-22370a12-4c4a-4bef-8857-8a410692187d tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.307378 Jul 28 17:53:12.469300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 491/998] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:12 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:12.600467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:12.600950 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:12.608345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.608837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.610086 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.610696 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.645652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-edfbfc94-095b-4473-937e-be4daca47937 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/ips" status: 200 len: 151 microversion: 2.1 time: 0.048888 Jul 28 17:53:12.646302 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 508/999] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:53:12 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:12.659905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0491fdb-b588-4aa5-b7a5-ba27ca1bf540"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:12.668237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:12.670364 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.671086 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.671885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.672328 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.770197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: POST /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/os-volume_attachments HTTP/1.1 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 74 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:53:12.772512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {"volumeAttachment": {"volumeId": "c0491fdb-b588-4aa5-b7a5-ba27ca1bf540"}} Jul 28 17:53:12.774168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'server_id': 'bd39380c-a0c4-4d3d-9498-25198768009e', 'body': {'volumeAttachment': {'volumeId': 'c0491fdb-b588-4aa5-b7a5-ba27ca1bf540'}}} Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:12.775570 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:12.776891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 400 to user: Invalid volume: volume c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 is already attached to instances: db521d28-6a27-47cd-b764-156c113ed677 {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e20901a2-1c36-4d35-a5c8-ad7c0e0f5363 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119822 Jul 28 17:53:12.778414 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 492/1000] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:53:12 2022] POST /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:53:12.784546 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:12.785407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:12.794196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.794640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.795786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.796338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.846547 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:53:12.957522 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-949664ad-929f-456f-8595-ac9ffba06a21 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 204 len: 0 microversion: 2.1 time: 0.176975 Jul 28 17:53:12.958402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 509/1001] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:53:12 2022] DELETE /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:53:12.966922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:12.967662 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:12.975383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.976190 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:12.977056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:12.977594 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:13.459769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:13.473690 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0cf7b970-6426-4a24-a82a-fadcdadd636d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1682 microversion: 2.1 time: 0.511149 Jul 28 17:53:13.488084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 493/1002] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:12 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1682 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:13.493413 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:13.495460 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:13.503971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:13.505378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:13.508616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:13.512583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:13.527729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-13bfc067-e055-41f5-a38e-86da1d75aacf req-788165b0-a7be-4842-a469-8c0dda2f7123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3be1fb1-d628-4716-ab27-55a1c366b3ce", "tag": "5f1ef98a-7335-483e-8655-aece35948e8f"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:13.540099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-13bfc067-e055-41f5-a38e-86da1d75aacf req-788165b0-a7be-4842-a469-8c0dda2f7123 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:13.540876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-13bfc067-e055-41f5-a38e-86da1d75aacf req-788165b0-a7be-4842-a469-8c0dda2f7123 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:13.553984 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-13bfc067-e055-41f5-a38e-86da1d75aacf req-788165b0-a7be-4842-a469-8c0dda2f7123 service nova] Creating event network-changed:5f1ef98a-7335-483e-8655-aece35948e8f for instance e3be1fb1-d628-4716-ab27-55a1c366b3ce on hv-cinder-81322 Jul 28 17:53:13.559193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-13bfc067-e055-41f5-a38e-86da1d75aacf req-788165b0-a7be-4842-a469-8c0dda2f7123 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037919 Jul 28 17:53:13.560207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 494/1003] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:53:13.669744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:13.677423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-62440d5b-7034-4882-9cc5-01dd1542e14f tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.201428 Jul 28 17:53:13.678005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 510/1004] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:13 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:14.496562 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:14.497287 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:14.503619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:14.504069 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:14.504831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:14.505296 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:14.522971 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=100 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:14.643483 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:14.652345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e33fda5c-941a-41db-a6b7-9d654c46ee4a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1682 microversion: 2.1 time: 0.160581 Jul 28 17:53:14.652916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 495/1005] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:14 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:14.700263 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:14.701007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:14.707688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:14.708217 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:14.709070 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:14.709635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:14.849855 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:14.858590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3626bbdf-84da-4950-b188-dbceb0b550c5 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.163136 Jul 28 17:53:14.859172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 511/1006] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:14 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:15.105772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-20c404e2-31d2-4af1-8ef7-b60692e81fbe tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a7bf670>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:15.159617 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-20c404e2-31d2-4af1-8ef7-b60692e81fbe tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/7b10e231-a624-462b-bb3a-df80ed94e8ec" status: 200 len: 350 microversion: 2.1 time: 0.058230 Jul 28 17:53:15.160436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 496/1007] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:53:15 2022] GET /compute/v2.1/os-volumes/7b10e231-a624-462b-bb3a-df80ed94e8ec => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:15.673720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:15.674605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:15.681493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:15.682096 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:15.682896 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:15.683397 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:15.818798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:15.827983 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7efaed07-8082-4682-8b4f-4cbdf66f9d15 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1682 microversion: 2.1 time: 0.158296 Jul 28 17:53:15.841342 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 512/1008] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:15 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:15.880760 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:15.881407 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:15.888264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:15.888866 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:15.889768 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:15.890256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:16.141761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:16.149317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c3019d89-4ebb-4dfe-a228-e25b0b54ed7e tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.273257 Jul 28 17:53:16.150208 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 497/1009] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:15 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:16.315666 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-911ad289-d515-4672-bfd7-cdad77514a64 req-8710b893-8c35-4b4b-870e-54acfdb0ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd39380c-a0c4-4d3d-9498-25198768009e", "name": "network-vif-deleted", "tag": "1f582e56-d95f-4ee1-99cb-467cbc456249"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:16.327078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-911ad289-d515-4672-bfd7-cdad77514a64 req-8710b893-8c35-4b4b-870e-54acfdb0ec21 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:16.327817 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-911ad289-d515-4672-bfd7-cdad77514a64 req-8710b893-8c35-4b4b-870e-54acfdb0ec21 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:16.341107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-911ad289-d515-4672-bfd7-cdad77514a64 req-8710b893-8c35-4b4b-870e-54acfdb0ec21 service nova] Creating event network-vif-deleted:1f582e56-d95f-4ee1-99cb-467cbc456249 for instance bd39380c-a0c4-4d3d-9498-25198768009e on hv-cinder-81322 Jul 28 17:53:16.346432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-911ad289-d515-4672-bfd7-cdad77514a64 req-8710b893-8c35-4b4b-870e-54acfdb0ec21 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Jul 28 17:53:16.347034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 513/1010] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:16.521234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c8ead13f-2e20-4d21-a91a-d0516ea8867b tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a7bfa60>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:16.572538 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c8ead13f-2e20-4d21-a91a-d0516ea8867b tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/407d8fb9-0525-43ae-a2a6-641ee8e561ae" status: 200 len: 351 microversion: 2.1 time: 0.054503 Jul 28 17:53:16.573179 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 498/1011] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:53:16 2022] GET /compute/v2.1/os-volumes/407d8fb9-0525-43ae-a2a6-641ee8e561ae => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:16.856423 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:16.858028 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:16.865055 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:16.865402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:16.866427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:16.867183 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:16.963399 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:16.974158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-059d8665-dbed-40fb-b8ef-9e07c16b3fa4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 200 len: 1615 microversion: 2.1 time: 0.124931 Jul 28 17:53:16.974949 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 514/1012] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:16 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 1615 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:17.172345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:17.172974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:17.179398 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:17.179841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:17.180603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:17.181198 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:17.330243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:17.352787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0f6470ec-1e9b-4137-84e3-ebaaa3aa062a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.184330 Jul 28 17:53:17.354358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 499/1013] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:17 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:17.995946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:17.997359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:18.002887 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b971c87a-e052-4fd0-a1ee-13cb7e39d098 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a76c280>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.004388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.004840 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.005833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.006279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.028114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e HTTP/1.1 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:18.029818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:53:18.031504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'bd39380c-a0c4-4d3d-9498-25198768009e'} Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:18.032366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:53:18.036360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:18.038892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:18.038892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5b3a6457-fcd9-408a-93f2-50e76082f03b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 404 len: 111 microversion: 2.1 time: 0.039368 Jul 28 17:53:18.038892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 515/1014] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:17 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:53:18.040743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ea690b58-17f2-4192-9bbb-571594d8cb19 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '.version_select at 0x7fce3a09f8b0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.059529 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b971c87a-e052-4fd0-a1ee-13cb7e39d098 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/d1c4c5e0-a6a1-425e-9aa0-cc1c4d5a27b7" status: 200 len: 347 microversion: 2.1 time: 0.060406 Jul 28 17:53:18.060156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 500/1015] 10.222.0.89 () {58 vars in 1245 bytes} [Thu Jul 28 17:53:17 2022] GET /compute/v2.1/os-volumes/d1c4c5e0-a6a1-425e-9aa0-cc1c4d5a27b7 => generated 347 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:53:18.067047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ea690b58-17f2-4192-9bbb-571594d8cb19 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579457859" status: 202 len: 0 microversion: 2.1 time: 0.030542 Jul 28 17:53:18.067886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 516/1016] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579457859 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:53:18.074858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2667c5b4-c581-4e13-8bba-1add1f9620e5 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a777790>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.159078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2667c5b4-c581-4e13-8bba-1add1f9620e5 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.089301 Jul 28 17:53:18.159784 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 501/1017] 10.222.0.89 () {58 vars in 1134 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:18.173384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f5b31f0a-70cd-4a6a-8cd4-f55209bfe245 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce39ffe430>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.260945 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f5b31f0a-70cd-4a6a-8cd4-f55209bfe245 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.090819 Jul 28 17:53:18.261546 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 517/1018] 10.222.0.89 () {58 vars in 1149 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:18.275026 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7f4630a2-859a-411f-8124-3abe3921a03f tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a736af0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.357667 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7f4630a2-859a-411f-8124-3abe3921a03f tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.086876 Jul 28 17:53:18.358261 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 502/1019] 10.222.0.89 () {58 vars in 1134 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:18.371447 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bb42fbbe-7944-4fc0-92d9-910ddb06a9cf tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a020280>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.374875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.375596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:18.383363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.383877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.384772 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.386095 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.459359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bb42fbbe-7944-4fc0-92d9-910ddb06a9cf tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092177 Jul 28 17:53:18.460043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 518/1020] 10.222.0.89 () {58 vars in 1167 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:18.473415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6611f735-a508-49fe-b5f8-8e85b32848a9 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce39f71040>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.560698 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6611f735-a508-49fe-b5f8-8e85b32848a9 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.090937 Jul 28 17:53:18.561292 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 519/1021] 10.222.0.89 () {58 vars in 1170 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:53:18.574404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5ceaab32-e737-41e2-9f6f-3c111999b3b8 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a0153a0>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.603270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:18.611434 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e0a8cc4c-d9ac-4620-a863-3e1b99266700 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.240633 Jul 28 17:53:18.612003 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 503/1022] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:18.674045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5ceaab32-e737-41e2-9f6f-3c111999b3b8 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.103405 Jul 28 17:53:18.674657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 520/1023] 10.222.0.89 () {58 vars in 1155 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:18.688908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ea5e8cde-550c-45be-86f6-1bf2a8f78cd8 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a799ca0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.877054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.877695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:18.884749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.885982 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.886848 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:18.887377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:18.935246 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ea5e8cde-550c-45be-86f6-1bf2a8f78cd8 tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.250309 Jul 28 17:53:18.935915 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 504/1024] 10.222.0.89 () {58 vars in 1188 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:18.950981 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-56940282-4a03-4140-aeed-0ef72c66253d tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] Calling method '.version_select at 0x7fce3a777f70>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:18.973173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'services' on Instance uuid db521d28-6a27-47cd-b764-156c113ed677 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:53:19.035083 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-56940282-4a03-4140-aeed-0ef72c66253d tempest-VolumesTestJSON-1401123276 tempest-VolumesTestJSON-1401123276-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.089563 Jul 28 17:53:19.035685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 505/1025] 10.222.0.89 () {58 vars in 1155 bytes} [Thu Jul 28 17:53:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:19.050275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8e335579-b958-493d-83a7-f0388184e818 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments/c0491fdb-b588-4aa5-b7a5-ba27ca1bf540" status: 202 len: 0 microversion: 2.1 time: 0.177281 Jul 28 17:53:19.050943 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 521/1026] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:53:18 2022] DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments/c0491fdb-b588-4aa5-b7a5-ba27ca1bf540 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 17:53:19.063499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:19.068921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:19.083054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:19.083842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:19.085169 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:19.085991 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:19.141906 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5d723dcf-8fa6-46dc-801c-08182d0f6912 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086427 Jul 28 17:53:19.142774 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 506/1027] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:53:19 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:19.365047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-9ece224e-2f8e-4b18-b2e5-3001a58f3da6 req-d776130c-1837-4b93-b630-f8b21519344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be1fb1-d628-4716-ab27-55a1c366b3ce", "name": "network-vif-plugged", "status": "completed", "tag": "5f1ef98a-7335-483e-8655-aece35948e8f"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:19.376197 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-9ece224e-2f8e-4b18-b2e5-3001a58f3da6 req-d776130c-1837-4b93-b630-f8b21519344c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:19.376750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-9ece224e-2f8e-4b18-b2e5-3001a58f3da6 req-d776130c-1837-4b93-b630-f8b21519344c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:19.389044 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-9ece224e-2f8e-4b18-b2e5-3001a58f3da6 req-d776130c-1837-4b93-b630-f8b21519344c service nova] Creating event network-vif-plugged:5f1ef98a-7335-483e-8655-aece35948e8f for instance e3be1fb1-d628-4716-ab27-55a1c366b3ce on hv-cinder-81322 Jul 28 17:53:19.394056 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-9ece224e-2f8e-4b18-b2e5-3001a58f3da6 req-d776130c-1837-4b93-b630-f8b21519344c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Jul 28 17:53:19.394762 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 522/1028] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:19.633148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:19.633952 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:19.641852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:19.642463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:19.643241 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:19.643673 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:19.785533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:19.796244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1d795645-5899-47a2-8fbe-cd7d58698d70 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.167367 Jul 28 17:53:19.796878 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 507/1029] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:19 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:20.152237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:20.152992 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=6 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:20.157959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:20.160196 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:20.168063 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:20.168500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:20.169286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:20.169713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:20.200246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a3b1f11a-d97e-440b-b29b-ebab5bbb0df4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049380 Jul 28 17:53:20.200830 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 523/1030] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:53:20 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:20.825759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:20.826358 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:20.828225 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:20.834191 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:20.834648 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:20.835428 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:20.835871 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:20.965672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:20.979399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-af206f4a-115b-4b0f-85b8-378126664c20 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1313 microversion: 2.1 time: 0.157364 Jul 28 17:53:20.980301 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 508/1031] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:20 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:21.213388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:21.215501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:21.218961 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:21.222850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.223297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.224061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.224496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.256232 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3e79acb2-3538-44fa-86ca-25e80195e13a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047356 Jul 28 17:53:21.256795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 524/1032] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:53:21 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:53:21.320455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:21.320953 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:21.327642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.328099 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.328872 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.329341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.359490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:53:21.440342 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e8b82682-f698-46c4-af43-cbab2be1d024 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 204 len: 0 microversion: 2.1 time: 0.123297 Jul 28 17:53:21.440947 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 509/1033] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:53:21 2022] DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:53:21.449723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:21.450356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:21.463691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.463691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.463691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:21.463691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:21.593739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:21.601638 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-293dfe6d-fb49-493d-b267-c065c6032dd1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1681 microversion: 2.1 time: 0.156405 Jul 28 17:53:21.602212 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 525/1034] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:21 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:22.001222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:22.002065 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:22.008470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.008916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.009702 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.010822 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.143944 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:22.151751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-798122d5-941b-4a01-bac8-2498d0cb090a tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1497 microversion: 2.1 time: 0.154794 Jul 28 17:53:22.152319 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 510/1035] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:21 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:22.623642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:22.624403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:22.632608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.633104 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.634137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.635106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.765404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:22.766093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:22.768308 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:22.776164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.776844 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.777671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.778114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.794520 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:22.803033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a3000ccb-de1b-44ef-802d-1fb16a39231d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1681 microversion: 2.1 time: 0.183952 Jul 28 17:53:22.803754 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 526/1036] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:22 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:22.807723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:53:22.904874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1d929d7e-b174-44ca-b0cc-aecc2148aec9 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "DELETE /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 204 len: 0 microversion: 2.1 time: 0.143049 Jul 28 17:53:22.905582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 511/1037] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:53:22 2022] DELETE /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 17:53:22.914763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:22.915417 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:22.922206 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.922654 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:22.923426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:22.923857 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:23.098549 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:23.106405 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1eac1e19-0b8b-485e-badc-4cc92067fdef tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1503 microversion: 2.1 time: 0.195881 Jul 28 17:53:23.106984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 527/1038] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:22 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:23.825710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:23.826634 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:23.834327 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:23.834787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:23.835569 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:23.836010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:23.979427 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:23.987484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-612ce761-6a0e-4db9-82fb-2bb0d7e5bf42 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1681 microversion: 2.1 time: 0.166413 Jul 28 17:53:23.988054 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 512/1039] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:23 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:24.128653 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:24.129362 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:24.136633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:24.137171 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:24.137951 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:24.138379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:24.278261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:24.281818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:24.290638 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f54d8d81-6ccb-4098-89c8-c9a1bcea25d3 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1503 microversion: 2.1 time: 0.166192 Jul 28 17:53:24.294078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 528/1040] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:24 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:25.010741 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:25.011566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:25.017577 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:25.018028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:25.018804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:25.019244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:25.155737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:25.163824 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-649c17bb-1177-4e97-8df4-8c97114f4412 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1681 microversion: 2.1 time: 0.157654 Jul 28 17:53:25.164490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 513/1041] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:25 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:25.315892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:25.316504 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:25.328524 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:25.328970 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:25.329770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:25.330195 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:25.469286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:25.477518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2d08fe3d-5f2e-41da-bf70-3475c2930d89 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1503 microversion: 2.1 time: 0.168089 Jul 28 17:53:25.478108 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 529/1042] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:25 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:26.187256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:26.188109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:26.194848 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:26.195424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:26.196271 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:26.196751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:26.450978 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-7f9148c8-4678-469a-a4d8-53077f1e8403 req-e6c82908-62e4-488a-b265-2f4576bce12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be1fb1-d628-4716-ab27-55a1c366b3ce", "name": "network-vif-deleted", "tag": "5f1ef98a-7335-483e-8655-aece35948e8f"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:26.465180 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-7f9148c8-4678-469a-a4d8-53077f1e8403 req-e6c82908-62e4-488a-b265-2f4576bce12b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:26.466233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-7f9148c8-4678-469a-a4d8-53077f1e8403 req-e6c82908-62e4-488a-b265-2f4576bce12b service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:26.480358 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-7f9148c8-4678-469a-a4d8-53077f1e8403 req-e6c82908-62e4-488a-b265-2f4576bce12b service nova] Creating event network-vif-deleted:5f1ef98a-7335-483e-8655-aece35948e8f for instance e3be1fb1-d628-4716-ab27-55a1c366b3ce on hv-cinder-81322 Jul 28 17:53:26.487014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-7f9148c8-4678-469a-a4d8-53077f1e8403 req-e6c82908-62e4-488a-b265-2f4576bce12b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044593 Jul 28 17:53:26.488240 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 530/1043] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:26.502649 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:26.503370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:26.506191 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:26.511766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:26.512739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:26.513769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:26.514371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:26.516603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cbb4f790-6eda-425c-aebb-0e33a9da08e8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1681 microversion: 2.1 time: 0.335068 Jul 28 17:53:26.526946 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 514/1044] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:26 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1681 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:26.611427 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedeb9e3e967402aa1458ceedf023dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f7a6e9080d48418e4912be02e09922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:26.620039 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e407db1a-76e0-4c9b-849c-a35f17ebaf71 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 200 len: 1298 microversion: 2.1 time: 0.122075 Jul 28 17:53:26.621517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 531/1045] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:26 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:53:27.540905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:27.543098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:27.549752 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:27.550201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:27.550968 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:27.551397 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:27.596861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:27.597637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:27.598452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'fault' on Instance uuid db521d28-6a27-47cd-b764-156c113ed677 {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:53:27.605727 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:27.643825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:27.644694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] [instance: e3be1fb1-d628-4716-ab27-55a1c366b3ce] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:27.646985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:27.656229 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ff63ae01-719d-4690-bba7-36f47b24464c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 200 len: 1330 microversion: 2.1 time: 0.118986 Jul 28 17:53:27.657446 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 515/1046] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:27 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:27.658892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:27.659347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:27.660127 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:27.660583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:27.686813 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] HTTP exception thrown: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Request method failure captured: Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce HTTP/1.1 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4szyQyAY9CEZM_7iz0qctHLXwdQJ-TYzmYXbYHNZ6tSq-cREUKs6NmH7kaeqXyFSBTwDDBR4jvbB9F3216THIiUk6B7pceuVrU1SjHLLHBfAerAgiYWHVGFR6kWZ6-vhgPfPHT3wBIFB1MFDFF6RGQkyIgZYiTh1YpSWod0CWYOkKv4 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 51f7a6e9080d48418e4912be02e09922 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesActionsTest-916486485 Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:27.688952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_51f7a6e9080d48418e4912be02e09922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/51f7a6e9080d48418e4912be02e09922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesActionsTest-916486485 Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 51f7a6e9080d48418e4912be02e09922 Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesActionsTest-916486485 Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesActionsTest-916486485-project Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: aedeb9e3e967402aa1458ceedf023dac Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesActionsTest-916486485-project Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. Jul 28 17:53:27.690626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'e3be1fb1-d628-4716-ab27-55a1c366b3ce'} Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:27.691622 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. Jul 28 17:53:27.693106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:27.698352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] Returning 404 to user: Instance e3be1fb1-d628-4716-ab27-55a1c366b3ce could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:27.700091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-737763be-4740-4ce0-8248-5f68d8c953e8 tempest-VolumesActionsTest-916486485 tempest-VolumesActionsTest-916486485-project] 10.222.0.89 "GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce" status: 404 len: 111 microversion: 2.1 time: 0.061215 Jul 28 17:53:27.701244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 532/1047] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:27 2022] GET /compute/v2.1/servers/e3be1fb1-d628-4716-ab27-55a1c366b3ce => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:53:28.508388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-31804e58-8ee6-414b-9337-fb501c423884 req-fe7f9a4c-cfaf-4d8e-8306-327d8e0c28f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db521d28-6a27-47cd-b764-156c113ed677", "name": "network-vif-deleted", "tag": "51d2b649-6b93-48cc-8e60-2002ccf154a4"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:28.517974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-31804e58-8ee6-414b-9337-fb501c423884 req-fe7f9a4c-cfaf-4d8e-8306-327d8e0c28f4 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:28.518730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-31804e58-8ee6-414b-9337-fb501c423884 req-fe7f9a4c-cfaf-4d8e-8306-327d8e0c28f4 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:28.531897 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-31804e58-8ee6-414b-9337-fb501c423884 req-fe7f9a4c-cfaf-4d8e-8306-327d8e0c28f4 service nova] Creating event network-vif-deleted:51d2b649-6b93-48cc-8e60-2002ccf154a4 for instance db521d28-6a27-47cd-b764-156c113ed677 on hv-cinder-81322 Jul 28 17:53:28.537488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-31804e58-8ee6-414b-9337-fb501c423884 req-fe7f9a4c-cfaf-4d8e-8306-327d8e0c28f4 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Jul 28 17:53:28.538432 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 516/1048] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:28.679424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:28.680026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:28.686787 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:28.687226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:28.687979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:28.688407 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:28.701866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 HTTP/1.1 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:28.703372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:53:28.704984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'db521d28-6a27-47cd-b764-156c113ed677'} Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:28.705858 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:53:28.707105 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:28.708236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:28.708236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-095bbcbd-9845-492b-83dc-3f7c9e08e8fa tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jul 28 17:53:28.708236 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 533/1049] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:28 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:53:28.715489 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d51cec94-da42-4d58-8dee-ddb988bd77f1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '.version_select at 0x7fce3a79c0d0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:28.734206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d51cec94-da42-4d58-8dee-ddb988bd77f1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-602287880" status: 202 len: 0 microversion: 2.1 time: 0.024066 Jul 28 17:53:28.734773 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 517/1050] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-602287880 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:53:29.595601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-581a0e21-bf1b-4b38-b799-329fd8c9bf3e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: .version_select at 0x7fce39ffedc0>, body: {"keypair": {"name": "tempest-keypair-925740980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaTPct+wC2/fnjmZdARUF5mzOKTjWaeG9SwhQ76MXwnzHAux3LpSBAQI8ciB5YO51dE9tFAGJodSQ7A1sffA/4k07oQbtW5/uj+8PvKGCV2/N1EkQoyUhnb95dkByEw4w=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:29.612497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-581a0e21-bf1b-4b38-b799-329fd8c9bf3e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:53:29.616273 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-581a0e21-bf1b-4b38-b799-329fd8c9bf3e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:53:29.639690 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-581a0e21-bf1b-4b38-b799-329fd8c9bf3e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047959 Jul 28 17:53:29.640430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 534/1051] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:53:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:30.942603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-243717944", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c7de1cf-fa0f-482c-9686-4fc41e18afb7"}], "security_groups": [{"name": "tempest-securitygroup--779679711"}], "key_name": "tempest-keypair-925740980", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:31.048039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] validate_networks() for [('4c7de1cf-fa0f-482c-9686-4fc41e18afb7', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:53:31.414748 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:53:31.415171 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:53:31.415643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:53:31.416047 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:53:31.416908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:53:31.426967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:31.427419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:31.428214 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:31.428642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:31.446005 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:53:31.450507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:53:31.461119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:53:31.464218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:53:31.509312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7052a8d3-7b92-448f-b944-47cb82f54c87 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572349 Jul 28 17:53:31.510531 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 518/1052] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:53:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:53:31.521601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0309542f-438f-465c-ada0-c58f6dbdc97b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:31.522209 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0309542f-438f-465c-ada0-c58f6dbdc97b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:31.578930 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0309542f-438f-465c-ada0-c58f6dbdc97b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:31.585495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0309542f-438f-465c-ada0-c58f6dbdc97b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1240 microversion: 2.1 time: 0.067774 Jul 28 17:53:31.586077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 535/1053] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:31 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:32.607704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:32.608288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:32.615455 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:32.615901 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:32.616665 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:32.617095 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:32.685317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:32.692735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-bc5fdc43-924f-4996-9c7f-d87401e9e5e0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1244 microversion: 2.1 time: 0.089721 Jul 28 17:53:32.693315 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 519/1054] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:32 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:33.716710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:33.717430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:33.724370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:33.724819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:33.725614 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:33.726046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:33.787878 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:33.795794 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ae3341b0-536f-4136-ad5e-f014d3c6c1d8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1244 microversion: 2.1 time: 0.084879 Jul 28 17:53:33.796365 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 536/1055] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:33 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:34.816840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:34.817503 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:34.824862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:34.825353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:34.826126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:34.826564 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:34.888393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:34.895826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9ef76d50-e2ea-43a3-bfce-3abd089676f4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1292 microversion: 2.1 time: 0.083000 Jul 28 17:53:34.896387 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 520/1056] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:34 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:35.919606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:35.920765 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:35.938613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:35.939548 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:35.940501 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:35.941237 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:36.114807 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:36.140372 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dec4789f-11a2-40d0-b0c7-80f40553f559 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.226242 Jul 28 17:53:36.141101 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 537/1057] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:35 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:36.913340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-a7c2d268-f3d8-4faf-ae42-c687b9db3418 req-7d9805e2-6b10-4f65-b412-edfb9e5e6780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d292fc-1ec6-4cd3-80a1-bf198ce23c9d", "tag": "b174a02c-65dd-4088-977c-9d0a804e228d"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:36.958721 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-a7c2d268-f3d8-4faf-ae42-c687b9db3418 req-7d9805e2-6b10-4f65-b412-edfb9e5e6780 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:36.959168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-a7c2d268-f3d8-4faf-ae42-c687b9db3418 req-7d9805e2-6b10-4f65-b412-edfb9e5e6780 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:37.000974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-a7c2d268-f3d8-4faf-ae42-c687b9db3418 req-7d9805e2-6b10-4f65-b412-edfb9e5e6780 service nova] Creating event network-changed:b174a02c-65dd-4088-977c-9d0a804e228d for instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d on hv-cinder-81322 Jul 28 17:53:37.015161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-a7c2d268-f3d8-4faf-ae42-c687b9db3418 req-7d9805e2-6b10-4f65-b412-edfb9e5e6780 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119086 Jul 28 17:53:37.016516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 521/1058] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:37.176618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:37.178132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:37.200559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:37.202441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:37.204975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:37.206740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:37.441363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:37.451737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1eae0692-161a-46cc-8e4b-6a7f9f05b49a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.291203 Jul 28 17:53:37.452750 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 538/1059] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:37 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:38.475647 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:38.476953 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:38.485270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:38.485725 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:38.486728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:38.487336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:38.665472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:38.689236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fad41869-8ec5-42e8-8370-8a2d2aa19e70 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.217458 Jul 28 17:53:38.690456 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 522/1060] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:38 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:39.711766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:39.712497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:39.721733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:39.723958 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:39.726892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:39.727345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:39.982955 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:39.998596 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a3745df8-691f-4908-923b-9a20b566d54b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.291209 Jul 28 17:53:40.016436 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 539/1061] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:39 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:41.022132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:41.023679 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:41.036436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:41.037181 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:41.038356 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:41.038978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:41.234268 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:41.242576 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-038d552c-3049-4d74-b68b-9c1394c05ea0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.224491 Jul 28 17:53:41.243727 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 523/1062] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:41 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:41.709926 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=6 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:41.716772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-74b605e0-4da1-4956-a60d-1e591197792f req-28683b89-632d-4973-834f-740aa5d84ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d292fc-1ec6-4cd3-80a1-bf198ce23c9d", "name": "network-vif-plugged", "status": "completed", "tag": "b174a02c-65dd-4088-977c-9d0a804e228d"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:41.735588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-74b605e0-4da1-4956-a60d-1e591197792f req-28683b89-632d-4973-834f-740aa5d84ee3 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:41.736643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-74b605e0-4da1-4956-a60d-1e591197792f req-28683b89-632d-4973-834f-740aa5d84ee3 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:41.754804 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-74b605e0-4da1-4956-a60d-1e591197792f req-28683b89-632d-4973-834f-740aa5d84ee3 service nova] Creating event network-vif-plugged:b174a02c-65dd-4088-977c-9d0a804e228d for instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d on hv-cinder-81322 Jul 28 17:53:41.763594 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-74b605e0-4da1-4956-a60d-1e591197792f req-28683b89-632d-4973-834f-740aa5d84ee3 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054098 Jul 28 17:53:41.764944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 540/1063] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:42.267833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:42.269429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:42.280884 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:42.282299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:42.285896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:42.286658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:42.287461 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:42.287902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:42.469683 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:42.478728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-11f409b1-652e-4501-95e6-d56ef5e91a99 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.217640 Jul 28 17:53:42.479289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 524/1064] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:42 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:43.502782 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:43.503789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:43.519109 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:43.520662 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:43.521759 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:43.522463 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:43.697023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:43.706220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-af451ee2-2602-461f-ba41-6dcb3ae92c59 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1365 microversion: 2.1 time: 0.208892 Jul 28 17:53:43.707342 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 541/1065] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:43 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:44.728412 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:44.729995 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:44.738030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:44.738604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:44.739484 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:44.740143 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:44.914895 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:44.930229 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-68390631-57f0-4d89-a977-91e24ba94300 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1555 microversion: 2.1 time: 0.205128 Jul 28 17:53:44.933614 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 525/1066] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:44 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1555 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:44.954166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:44.954981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:44.961513 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:44.962151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:44.963188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:44.963792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:45.092434 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9c003eb5-5d84-4aa5-a53c-0e6bdeee594a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142416 Jul 28 17:53:45.093665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 542/1067] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:53:44 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:46.405384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-4d66ced2-d7c2-4023-bc04-e92e955080fc req-7a9f983b-64fb-4e9e-87c5-81a4bf16d428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d292fc-1ec6-4cd3-80a1-bf198ce23c9d", "tag": "b174a02c-65dd-4088-977c-9d0a804e228d"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:46.426921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4d66ced2-d7c2-4023-bc04-e92e955080fc req-7a9f983b-64fb-4e9e-87c5-81a4bf16d428 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:46.428167 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4d66ced2-d7c2-4023-bc04-e92e955080fc req-7a9f983b-64fb-4e9e-87c5-81a4bf16d428 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:46.445859 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-4d66ced2-d7c2-4023-bc04-e92e955080fc req-7a9f983b-64fb-4e9e-87c5-81a4bf16d428 service nova] Creating event network-changed:b174a02c-65dd-4088-977c-9d0a804e228d for instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d on hv-cinder-81322 Jul 28 17:53:46.453504 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-4d66ced2-d7c2-4023-bc04-e92e955080fc req-7a9f983b-64fb-4e9e-87c5-81a4bf16d428 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052322 Jul 28 17:53:46.459316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 526/1068] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:52.530162 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:52.531027 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:52.538890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:52.560610 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-5627968c-67ae-4717-a3e4-d4f5919b531c req-acc48623-4743-45f4-b344-edc706da660f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:52.569871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:52.570329 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:52.571244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:52.571797 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:52.583556 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-5627968c-67ae-4717-a3e4-d4f5919b531c req-acc48623-4743-45f4-b344-edc706da660f service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:52.585826 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-5627968c-67ae-4717-a3e4-d4f5919b531c req-acc48623-4743-45f4-b344-edc706da660f service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:52.614048 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-5627968c-67ae-4717-a3e4-d4f5919b531c req-acc48623-4743-45f4-b344-edc706da660f service nova] Creating event network-changed:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:53:52.627185 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-5627968c-67ae-4717-a3e4-d4f5919b531c req-acc48623-4743-45f4-b344-edc706da660f service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071087 Jul 28 17:53:52.628281 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 527/1069] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:53:52.638220 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:53:52.806158 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7d11b550-839e-4377-9363-a928f36cfd98 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "DELETE /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 204 len: 0 microversion: 2.1 time: 0.283894 Jul 28 17:53:52.809293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 543/1070] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:53:52 2022] DELETE /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:53:52.820960 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:52.821983 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:52.825105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:52.831624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:52.832967 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:52.834198 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:52.834803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:53.015436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:53.024827 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-f6ad3fcc-2275-42b1-8a60-fbe92b09095a tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.210469 Jul 28 17:53:53.026221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 528/1071] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:52 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:54.047755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:54.048608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:54.055106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:54.055557 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:54.056343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:54.056756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:54.194727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:54.203100 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3356eb24-dab7-42f6-8ba8-4460f13c5413 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1568 microversion: 2.1 time: 0.159840 Jul 28 17:53:54.203666 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 544/1072] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:54 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:55.224340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:55.224951 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:55.231852 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:55.232847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:55.233084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:55.233553 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:55.493187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:55.501616 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a7c9e0f6-5f59-4536-9b47-720a36ea6f08 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1450 microversion: 2.1 time: 0.281269 Jul 28 17:53:55.502464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 529/1073] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:55 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1450 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:55.811668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-a7bde659-a994-482f-8737-34629ab88465 req-2b2a883e-13d7-4dbe-8feb-56b4b7991d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd", "name": "network-vif-deleted", "tag": "dc52a880-fa63-4cb8-9043-9a3589099ae5"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:53:55.836578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a7bde659-a994-482f-8737-34629ab88465 req-2b2a883e-13d7-4dbe-8feb-56b4b7991d4d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:55.837024 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-a7bde659-a994-482f-8737-34629ab88465 req-2b2a883e-13d7-4dbe-8feb-56b4b7991d4d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:55.841839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:55.850544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-a7bde659-a994-482f-8737-34629ab88465 req-2b2a883e-13d7-4dbe-8feb-56b4b7991d4d service nova] Creating event network-vif-deleted:dc52a880-fa63-4cb8-9043-9a3589099ae5 for instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd on hv-cinder-81322 Jul 28 17:53:55.856032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-a7bde659-a994-482f-8737-34629ab88465 req-2b2a883e-13d7-4dbe-8feb-56b4b7991d4d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049239 Jul 28 17:53:55.856812 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 545/1074] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:53:56.525123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:56.525861 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:56.533330 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:56.533723 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:56.534587 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:56.535028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:56.569879 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:56.570554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:56.571691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lazy-loading 'fault' on Instance uuid eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:53:56.614452 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd17607cef54135a91f39ccd74b6180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef795b478944722886f1d084f49008d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:53:56.626715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5b11bf81-5d36-45b1-95ca-444ad9a32cb0 tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 200 len: 1224 microversion: 2.1 time: 0.103439 Jul 28 17:53:56.628100 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 530/1075] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:56 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:53:57.655225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:57.656041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] [instance: eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:53:57.670892 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:57.671443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:57.672276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:53:57.672717 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:53:57.697214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] HTTP exception thrown: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Request method failure captured: Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd HTTP/1.1 Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4su36D72GOoTB1WZDnpSGK51vLzFmftxm32BswCAMfxLg4zHGqIJfjK5OG2-RptkiSqKMw0IaZ-nfb33la_zH6QEFkv108jgjEpA7QnbmMe-wjY15zS4t-YABF8bzmAbZjzSmtL-f7txCIb76XqG8ig6w_LOCAew5SDifHo5nhegoKk Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 0ef795b478944722886f1d084f49008d Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-TestShelveInstance-721217208 Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:53:57.699429 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/0ef795b478944722886f1d084f49008d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_0ef795b478944722886f1d084f49008d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0ef795b478944722886f1d084f49008d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/0ef795b478944722886f1d084f49008d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-TestShelveInstance-721217208 Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 0ef795b478944722886f1d084f49008d Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-TestShelveInstance-721217208 Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-TestShelveInstance-721217208-project Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 1cd17607cef54135a91f39ccd74b6180 Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-TestShelveInstance-721217208-project Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. Jul 28 17:53:57.701121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd'} Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:53:57.702045 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. Jul 28 17:53:57.703564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:53:57.704902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Returning 404 to user: Instance eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:53:57.704902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-601db842-14f5-4d51-aef5-42fb721fd82b tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd" status: 404 len: 111 microversion: 2.1 time: 0.052581 Jul 28 17:53:57.704902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 546/1076] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:53:57 2022] GET /compute/v2.1/servers/eb97c2e1-2c9c-4fdd-b1a4-d7d2043ed5dd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:53:57.896769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a200f1a6-5817-4283-a24c-a14cbfc0681d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] Calling method '.version_select at 0x7fce3b1eca60>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:53:57.939424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a200f1a6-5817-4283-a24c-a14cbfc0681d tempest-TestShelveInstance-721217208 tempest-TestShelveInstance-721217208-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-552830010" status: 202 len: 0 microversion: 2.1 time: 0.050326 Jul 28 17:53:57.940847 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 531/1077] 10.222.0.89 () {58 vars in 1251 bytes} [Thu Jul 28 17:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-552830010 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:54:39.303484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:39.304155 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:39.322918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:39.323997 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:39.325755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:39.326200 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:39.326979 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:39.328283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:39.356245 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c9211c8e-d788-4c32-acf1-379c26623721 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/ips" status: 200 len: 149 microversion: 2.1 time: 0.056158 Jul 28 17:54:39.357077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 547/1078] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:54:39 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:40.825404 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c20cddaa-015d-404a-a242-b6e8b3a870a6"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:40.828516 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:40.831644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=68 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:40.833037 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:40.840578 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:40.841386 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:40.842423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:40.843082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:41.223678 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1ac3461b-da84-441b-8c8e-938da10bf757 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Action: 'create', calling method: .version_select at 0x7fce3a0803a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-858831229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM9UZIFfEiwxpzmSnhk2UVIgYGytPZiGP3QzT+M0L1u3gqRx2726R5tR69cnuXuICnCvBZvh693Xx+ahZemwI/6KgNK+Ibyl4KANBCyTbpGjPEbvFF2ENQGZnyScHiJYg=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:41.240796 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-1ac3461b-da84-441b-8c8e-938da10bf757 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for project 1f721aa2c35842beba2060fde666b2a1. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:54:41.245016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-1ac3461b-da84-441b-8c8e-938da10bf757 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for user c4618ca07ce2408ba90e9eaab0b940c9 and project 1f721aa2c35842beba2060fde666b2a1. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:54:41.270057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1ac3461b-da84-441b-8c8e-938da10bf757 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.245198 Jul 28 17:54:41.270722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 548/1079] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:54:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:54:41.425875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-fc081367-b43a-4f28-bf2a-365e932ee930 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605462 Jul 28 17:54:41.426736 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 532/1080] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:54:40 2022] POST /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:49.013673 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c20cddaa-015d-404a-a242-b6e8b3a870a6"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:49.016014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:49.023675 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.024118 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.024890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.025352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.163174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: POST /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments HTTP/1.1 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 74 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:54:49.165043 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {"volumeAttachment": {"volumeId": "c20cddaa-015d-404a-a242-b6e8b3a870a6"}} Jul 28 17:54:49.166825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'server_id': '05d292fc-1ec6-4cd3-80a1-bf198ce23c9d', 'body': {'volumeAttachment': {'volumeId': 'c20cddaa-015d-404a-a242-b6e8b3a870a6'}}} Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:49.167770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:49.169295 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 400 to user: Invalid volume: volume c20cddaa-015d-404a-a242-b6e8b3a870a6 is already attached to instances: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-6f374140-d15f-4945-bb32-3e62215d8467 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157498 Jul 28 17:54:49.170980 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 549/1081] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:54:49 2022] POST /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 17:54:49.234143 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:49.234735 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:49.241050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.241743 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.242310 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.242750 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.367669 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'services' on Instance uuid 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:54:49.486747 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8d1907c1-d6a9-4c46-9d34-8afb4bfac0f0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments/c20cddaa-015d-404a-a242-b6e8b3a870a6" status: 202 len: 0 microversion: 2.1 time: 0.257142 Jul 28 17:54:49.488804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 533/1082] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:54:49 2022] DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments/c20cddaa-015d-404a-a242-b6e8b3a870a6 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:54:49.497141 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:49.499571 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:49.507388 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.507837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.508656 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:49.509132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:49.542839 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5ad5946c-d8ce-447b-b322-096754c7e69a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049624 Jul 28 17:54:49.543401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 550/1083] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:54:49 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:50.555881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:50.558238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:50.564842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.565381 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.566374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.566812 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.598070 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-522b7112-6882-44c3-9513-96115f10bd8c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046324 Jul 28 17:54:50.598635 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 534/1084] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:54:50 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 17:54:50.661135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:50.661709 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:50.668042 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.668484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.669259 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.669689 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.694745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:54:50.774390 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-61c4416f-8b23-4b8e-80d7-5f935597a79c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 204 len: 0 microversion: 2.1 time: 0.117655 Jul 28 17:54:50.774948 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 551/1085] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:54:50 2022] DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:54:50.783650 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:50.785395 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:50.791830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.792278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.793053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:50.793514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:50.935015 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:50.942680 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dde54608-e19f-4b21-8e46-6b46917287f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1679 microversion: 2.1 time: 0.163096 Jul 28 17:54:50.943234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 535/1086] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:50 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:54:51.965007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:51.965766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:51.967681 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=4 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:51.974110 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:51.974549 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:51.975304 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:51.975732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:52.108260 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:52.116897 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e5f88131-7565-4d6d-a0ee-0a3b4396adbd tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1679 microversion: 2.1 time: 0.156605 Jul 28 17:54:52.117627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 552/1087] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:51 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:53.138598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:53.139204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:53.146481 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:53.147027 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:53.147831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:53.148261 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:53.389279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:53.397691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8d8c1447-4611-4c3a-849f-8b138933d864 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1679 microversion: 2.1 time: 0.262643 Jul 28 17:54:53.398512 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 536/1088] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:53 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:54.070876 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-5f87dc86-9a19-402c-96c9-0ff6c7af912e req-083d8fed-58a5-4a15-ab78-b9ec0c853c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d292fc-1ec6-4cd3-80a1-bf198ce23c9d", "name": "network-vif-deleted", "tag": "b174a02c-65dd-4088-977c-9d0a804e228d"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:54.080713 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5f87dc86-9a19-402c-96c9-0ff6c7af912e req-083d8fed-58a5-4a15-ab78-b9ec0c853c90 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:54.081347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-5f87dc86-9a19-402c-96c9-0ff6c7af912e req-083d8fed-58a5-4a15-ab78-b9ec0c853c90 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:54.092755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-5f87dc86-9a19-402c-96c9-0ff6c7af912e req-083d8fed-58a5-4a15-ab78-b9ec0c853c90 service nova] Creating event network-vif-deleted:b174a02c-65dd-4088-977c-9d0a804e228d for instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d on hv-cinder-81322 Jul 28 17:54:54.098430 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-5f87dc86-9a19-402c-96c9-0ff6c7af912e req-083d8fed-58a5-4a15-ab78-b9ec0c853c90 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Jul 28 17:54:54.099277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 553/1089] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:54.420010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:54.420611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:54.428173 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:54.428619 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:54.429425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:54.429858 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:54.462196 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:54.462639 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:54.463092 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.objects.instance [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'fault' on Instance uuid 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d {{(pid=124516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:54:54.510514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:54.519204 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-204e10cc-50fa-42f9-a0f7-b6832f9df53d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 200 len: 1330 microversion: 2.1 time: 0.102970 Jul 28 17:54:54.519978 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 537/1090] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:54 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:55.542106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:55.542837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:55.549629 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:55.550228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:55.551006 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:55.551500 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:55.565696 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d HTTP/1.1 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:54:55.567449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:54:55.569087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '05d292fc-1ec6-4cd3-80a1-bf198ce23c9d'} Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:54:55.570188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:54:55.571735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:54:55.573330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:54:55.573330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-db1bf75f-de4a-4289-92b1-02f766822e30 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 404 len: 111 microversion: 2.1 time: 0.031457 Jul 28 17:54:55.573330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 554/1091] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:55 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:54:55.577753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-73c6e4b7-04d5-44d0-8155-c4f91c7920c2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '.version_select at 0x7fce3b3b75e0>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:55.598146 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-73c6e4b7-04d5-44d0-8155-c4f91c7920c2 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925740980" status: 202 len: 0 microversion: 2.1 time: 0.024036 Jul 28 17:54:55.598806 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 538/1092] 10.222.0.89 () {58 vars in 1218 bytes} [Thu Jul 28 17:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925740980 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:54:56.224971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9aa299dd-6c44-44c0-87bf-b20ac699f612 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: .version_select at 0x7fce3a07aa60>, body: {"keypair": {"name": "tempest-keypair-1484019423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJcn7SKBrui1izY2Th2NdzekG4/jXEACJh219o2fQWV+kjCqLKyQjmgD/+SEA9WD9f4ouQPtUGlX9Eyh/WJE5IJiPauRtx+oflyvSGtyJd4RewcZj/WNucTyav6szy1dQ=="}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:56.240138 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-9aa299dd-6c44-44c0-87bf-b20ac699f612 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:54:56.243954 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-9aa299dd-6c44-44c0-87bf-b20ac699f612 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'key_pairs'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:54:56.265527 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9aa299dd-6c44-44c0-87bf-b20ac699f612 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045127 Jul 28 17:54:56.266116 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 555/1093] 10.222.0.89 () {60 vars in 1159 bytes} [Thu Jul 28 17:54:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:57.798213 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-388549751", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c7de1cf-fa0f-482c-9686-4fc41e18afb7"}], "security_groups": [{"name": "tempest-securitygroup--615355371"}], "key_name": "tempest-keypair-1484019423", "user_data": "}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:57.905077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] validate_networks() for [('4c7de1cf-fa0f-482c-9686-4fc41e18afb7', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:54:58.292211 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:54:58.292637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:54:58.293112 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:54:58.293558 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:54:58.293970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:54:58.303371 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:58.303820 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:58.304626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:58.305064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:58.322709 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:54:58.326677 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Getting quotas for user 39ff02cba2fd4e7b9fb27b98b9daa82e and project 72a9ad9df4f84c658e9964f1a0c0b282. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:54:58.337885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:54:58.340055 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:54:58.389265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1cd61d08-ed2b-4d08-a0ab-240286d066e4 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596128 Jul 28 17:54:58.390105 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 539/1094] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:54:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:54:58.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8fbfc600-ce99-45e3-acfc-e05bd52bd2ad tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:58.403131 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8fbfc600-ce99-45e3-acfc-e05bd52bd2ad tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:58.464137 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8fbfc600-ce99-45e3-acfc-e05bd52bd2ad tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:58.471213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8fbfc600-ce99-45e3-acfc-e05bd52bd2ad tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1241 microversion: 2.1 time: 0.073548 Jul 28 17:54:58.471803 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 556/1095] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:58 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:58.888080 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1225325622", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858831229", "security_groups": [{"name": "tempest-secgroup-smoke-1200150"}], "block_device_mapping_v2": [{"uuid": "121db463-0aed-470f-95a7-a54a75f13b43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41cb40d0-5f53-4baf-b3ce-649cb31f7aff"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:59.007343 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] validate_networks() for [('41cb40d0-5f53-4baf-b3ce-649cb31f7aff', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:54:59.390433 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:54:59.390862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:54:59.391988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:54:59.392410 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:54:59.393436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:54:59.402726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:59.403172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:59.404087 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:59.404622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:59.423441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:54:59.427886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for user c4618ca07ce2408ba90e9eaab0b940c9 and project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:54:59.492454 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.494060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:59.495472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:54:59.497970 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='121db463-0aed-470f-95a7-a54a75f13b43',volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:54:59.501408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:59.502902 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:59.504834 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:54:59.505468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:54:59.577468 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:59.585352 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-59e3e29e-3c14-40a0-b1c2-3d4d1fed03db tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1311 microversion: 2.1 time: 0.097102 Jul 28 17:54:59.585931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 557/1096] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:59.660191 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cebe070a-3dfc-403c-b48c-ff6f1f5b2084 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.776637 Jul 28 17:54:59.660928 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 540/1097] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:54:58 2022] POST /compute/v2.1/servers => generated 403 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:54:59.671623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5e85b6fa-5055-4797-baba-2bf0aeef6658 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.672554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5e85b6fa-5055-4797-baba-2bf0aeef6658 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:54:59.726693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5e85b6fa-5055-4797-baba-2bf0aeef6658 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:54:59.733243 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5e85b6fa-5055-4797-baba-2bf0aeef6658 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1094 microversion: 2.1 time: 0.065455 Jul 28 17:54:59.733814 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 558/1098] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:00.606688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:00.607378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:00.614202 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:00.614646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:00.615424 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:00.615855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:00.754697 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:00.755325 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:00.762146 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:00.762597 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:00.763375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:00.763990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:00.850786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:00.858721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cf5fd67e-e128-40da-95dd-292451a660eb tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1200 microversion: 2.1 time: 0.109217 Jul 28 17:55:00.859471 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 559/1099] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:00 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:00.948277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:00.957567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c0f423fe-43c3-4ead-931b-69c8ba54e463 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.355094 Jul 28 17:55:00.958156 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 541/1100] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:00 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:01.801190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-7ad1a8ff-2de4-4a72-b8b8-e8f0f100691d req-4e21e4cb-ceb4-4c37-be81-384e37d273c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97639f29-3303-412a-bfe8-ae245c93aeb3", "tag": "cd3e5d20-60d4-47f9-bfc5-f661a8ea28df"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:01.821202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-7ad1a8ff-2de4-4a72-b8b8-e8f0f100691d req-4e21e4cb-ceb4-4c37-be81-384e37d273c0 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:01.821944 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-7ad1a8ff-2de4-4a72-b8b8-e8f0f100691d req-4e21e4cb-ceb4-4c37-be81-384e37d273c0 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:01.841339 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-7ad1a8ff-2de4-4a72-b8b8-e8f0f100691d req-4e21e4cb-ceb4-4c37-be81-384e37d273c0 service nova] Creating event network-changed:cd3e5d20-60d4-47f9-bfc5-f661a8ea28df for instance 97639f29-3303-412a-bfe8-ae245c93aeb3 on hv-cinder-81322 Jul 28 17:55:01.848620 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-7ad1a8ff-2de4-4a72-b8b8-e8f0f100691d req-4e21e4cb-ceb4-4c37-be81-384e37d273c0 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051410 Jul 28 17:55:01.849843 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 560/1101] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:01.881384 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.882032 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:01.889382 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:01.890172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:01.891144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:01.891644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:01.986313 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.986495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:01.987087 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:01.993695 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:01.994384 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:01.995108 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e6edcf04-e568-4b90-a1ed-89b4e5c7377f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1198 microversion: 2.1 time: 0.118725 Jul 28 17:55:01.995254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:01.995578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:01.996075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 542/1102] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:01 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1198 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:02.141431 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:02.150000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ee084b93-7646-41a2-8879-483bbfe2c1a3 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.167846 Jul 28 17:55:02.151121 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 561/1103] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:01 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:03.016885 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:03.018098 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:03.024843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:03.025351 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:03.026140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:03.026730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:03.175443 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:03.175975 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:03.182601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:03.183048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:03.183819 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:03.184247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:03.335935 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:03.347426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-09e9992c-f4ae-439f-9b24-90ce41c35a6c tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.176641 Jul 28 17:55:03.348587 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 562/1104] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:03 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:03.527863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:03.536574 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1a24153b-0f48-4352-a97b-834358f1898a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.524117 Jul 28 17:55:03.549900 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 543/1105] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:03 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:03.874338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-e64ed401-252f-496e-99d5-07f49e6c91aa req-1919709f-333d-4cb5-bfc9-8fe0c312c1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a3017f-73cc-4824-a620-0bc87d8181a5", "tag": "be5145df-9a81-462a-86a2-55023b825699"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:03.888872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e64ed401-252f-496e-99d5-07f49e6c91aa req-1919709f-333d-4cb5-bfc9-8fe0c312c1ca service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:03.889438 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e64ed401-252f-496e-99d5-07f49e6c91aa req-1919709f-333d-4cb5-bfc9-8fe0c312c1ca service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:03.904189 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-e64ed401-252f-496e-99d5-07f49e6c91aa req-1919709f-333d-4cb5-bfc9-8fe0c312c1ca service nova] Creating event network-changed:be5145df-9a81-462a-86a2-55023b825699 for instance e7a3017f-73cc-4824-a620-0bc87d8181a5 on hv-cinder-81322 Jul 28 17:55:03.911866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-e64ed401-252f-496e-99d5-07f49e6c91aa req-1919709f-333d-4cb5-bfc9-8fe0c312c1ca service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044111 Jul 28 17:55:03.912470 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 563/1106] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:04.370102 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:04.370620 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:04.378922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:04.379355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:04.380133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:04.380567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:04.559272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:04.560776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:04.568022 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:04.568479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:04.569416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:04.570060 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:04.640889 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:04.650006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5200ea2a-a197-4c76-aa59-10145db83d41 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.283509 Jul 28 17:55:04.665598 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 544/1107] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:04 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:04.721403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:04.729098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b4b4488f-3d8c-4f94-916f-5220dc1386c3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.174546 Jul 28 17:55:04.729740 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 564/1108] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:04 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:05.673567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:05.674534 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:05.681123 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:05.681606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:05.682383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:05.682815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:05.750798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:05.751404 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:05.758585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:05.759041 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:05.759817 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:05.760254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:05.817249 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:05.824896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d7e83fb5-bab9-4c03-948d-810e6d625e05 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.155654 Jul 28 17:55:05.825499 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 545/1109] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:05 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:05.896184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:05.903874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-348c1eec-9393-473e-bb3c-41450559726a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.157040 Jul 28 17:55:05.904419 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 565/1110] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:05 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:06.100856 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-8373bae9-f2ea-4fed-aa1a-63606fe8cfc6 req-c34bfc07-0fa0-4df3-b270-c885242e2331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97639f29-3303-412a-bfe8-ae245c93aeb3", "name": "network-vif-plugged", "status": "completed", "tag": "cd3e5d20-60d4-47f9-bfc5-f661a8ea28df"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:06.110328 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-8373bae9-f2ea-4fed-aa1a-63606fe8cfc6 req-c34bfc07-0fa0-4df3-b270-c885242e2331 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:06.110770 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-8373bae9-f2ea-4fed-aa1a-63606fe8cfc6 req-c34bfc07-0fa0-4df3-b270-c885242e2331 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:06.122607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-8373bae9-f2ea-4fed-aa1a-63606fe8cfc6 req-c34bfc07-0fa0-4df3-b270-c885242e2331 service nova] Creating event network-vif-plugged:cd3e5d20-60d4-47f9-bfc5-f661a8ea28df for instance 97639f29-3303-412a-bfe8-ae245c93aeb3 on hv-cinder-81322 Jul 28 17:55:06.127873 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-8373bae9-f2ea-4fed-aa1a-63606fe8cfc6 req-c34bfc07-0fa0-4df3-b270-c885242e2331 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030389 Jul 28 17:55:06.128406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 546/1111] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:06.845929 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:06.846536 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:06.853507 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:06.853956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:06.854719 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:06.855154 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:06.925511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:06.926221 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:06.933000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:06.933000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:06.933776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:06.934216 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:06.986544 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:06.994625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4a4d2f96-079c-4856-8c2f-c5a32ce5a8bc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1366 microversion: 2.1 time: 0.152536 Jul 28 17:55:06.995276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 566/1112] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:06 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:07.069036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:07.076791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-ce3e671d-03e8-41ab-a151-7bf3e45d8391 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.156265 Jul 28 17:55:07.077396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 547/1113] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:06 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:08.016564 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:08.017214 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:08.024751 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.025241 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.026004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.026433 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.099497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:08.100061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:08.106560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.107001 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.107766 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.108190 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.163947 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:08.172057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-3588ff9d-811e-4b66-b1e7-0feed2da5849 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1557 microversion: 2.1 time: 0.159344 Jul 28 17:55:08.172627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 567/1114] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:08 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:08.192611 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:08.193106 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:08.199147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.199593 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.200391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:08.200818 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:08.243652 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:08.251630 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4c3076d3-618e-4fa8-9893-178bb38869b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.157324 Jul 28 17:55:08.252243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 548/1115] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:08 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:55:08.280566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5159ed19-1d48-474f-9f73-d099ebb943ef tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091689 Jul 28 17:55:08.281185 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 568/1116] 10.222.0.89 () {58 vars in 1275 bytes} [Thu Jul 28 17:55:08 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:55:09.223791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-81bcb65a-990a-4a4a-8415-de1e5b79d868 req-bf3aaba5-7bf2-4357-8c9b-94e9c20e0bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97639f29-3303-412a-bfe8-ae245c93aeb3", "tag": "cd3e5d20-60d4-47f9-bfc5-f661a8ea28df"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:09.235653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-81bcb65a-990a-4a4a-8415-de1e5b79d868 req-bf3aaba5-7bf2-4357-8c9b-94e9c20e0bd7 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:09.236464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-81bcb65a-990a-4a4a-8415-de1e5b79d868 req-bf3aaba5-7bf2-4357-8c9b-94e9c20e0bd7 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:09.243857 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:09.254582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-81bcb65a-990a-4a4a-8415-de1e5b79d868 req-bf3aaba5-7bf2-4357-8c9b-94e9c20e0bd7 service nova] Creating event network-changed:cd3e5d20-60d4-47f9-bfc5-f661a8ea28df for instance 97639f29-3303-412a-bfe8-ae245c93aeb3 on hv-cinder-81322 Jul 28 17:55:09.260042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-81bcb65a-990a-4a4a-8415-de1e5b79d868 req-bf3aaba5-7bf2-4357-8c9b-94e9c20e0bd7 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040509 Jul 28 17:55:09.261030 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 549/1117] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:09.273136 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:09.273772 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:09.280107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:09.280551 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:09.281356 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:09.281792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:09.307093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:09.431084 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:09.438467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a7ca5fc1-ef82-4f7b-87d6-3b211b6c3bdf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.169781 Jul 28 17:55:09.439202 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 569/1118] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:09 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:10.457458 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=4 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:10.458444 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=12 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:10.463223 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:10.463934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:10.472754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:10.473248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:10.474036 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:10.474479 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:10.612579 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:10.620053 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8a0ec844-78df-46c4-a702-83db72776147 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.163641 Jul 28 17:55:10.620622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 550/1119] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:10 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:11.640606 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:11.642178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:11.644337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=8 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:11.645558 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:11.651201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:11.651644 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:11.652660 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:11.653085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:11.787633 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:11.795170 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-45ea9c4c-eb8d-496b-b895-6db83490c3b1 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.158545 Jul 28 17:55:11.795764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 570/1120] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:11 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:12.817071 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:12.817796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:12.819963 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:12.826116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:12.826582 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:12.827359 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:12.827796 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:12.962337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:12.969849 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-c3a26b29-34f5-4a71-9850-55596b9371f4 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.157537 Jul 28 17:55:12.970420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 551/1121] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:12 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:13.991908 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:13.992472 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:13.999071 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:13.999514 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:14.000270 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:14.000710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:14.135025 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:14.143871 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a390e030-cc03-4f5b-86dd-6a5c2e825c1a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.155922 Jul 28 17:55:14.144655 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 571/1122] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:13 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:14.171454 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-6d523f5e-ccb3-4c62-a286-8f9f266f7f65 req-758a85b5-eac2-4d4c-b712-278d4ff4a749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a3017f-73cc-4824-a620-0bc87d8181a5", "name": "network-vif-plugged", "status": "completed", "tag": "be5145df-9a81-462a-86a2-55023b825699"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:14.182305 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6d523f5e-ccb3-4c62-a286-8f9f266f7f65 req-758a85b5-eac2-4d4c-b712-278d4ff4a749 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:14.182921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6d523f5e-ccb3-4c62-a286-8f9f266f7f65 req-758a85b5-eac2-4d4c-b712-278d4ff4a749 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:14.194145 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-6d523f5e-ccb3-4c62-a286-8f9f266f7f65 req-758a85b5-eac2-4d4c-b712-278d4ff4a749 service nova] Creating event network-vif-plugged:be5145df-9a81-462a-86a2-55023b825699 for instance e7a3017f-73cc-4824-a620-0bc87d8181a5 on hv-cinder-81322 Jul 28 17:55:14.198891 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-6d523f5e-ccb3-4c62-a286-8f9f266f7f65 req-758a85b5-eac2-4d4c-b712-278d4ff4a749 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Jul 28 17:55:14.199490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 552/1123] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:15.165721 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:15.166254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:15.172703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:15.173144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:15.174293 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:15.174725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:15.310363 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:15.318516 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bfb9d353-d164-4a14-b057-5386e3f65e98 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1263 microversion: 2.1 time: 0.156934 Jul 28 17:55:15.319089 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 572/1124] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:15 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:16.340744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:16.341462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:16.347815 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:16.348258 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:16.349712 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:16.350148 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:16.488253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:16.496076 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1f02f416-6b0b-47e3-b956-6a8bbf6fb9ad tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1449 microversion: 2.1 time: 0.159996 Jul 28 17:55:16.496638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 553/1125] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:16 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:16.516625 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:16.517267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:16.524693 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:16.525139 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:16.525917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:16.526476 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:16.661439 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:55:16.669512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bb6c0fd3-f73b-42a0-8b46-e45f51e6b034 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1449 microversion: 2.1 time: 0.156696 Jul 28 17:55:16.670077 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 573/1126] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:55:16 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:55:18.634701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-7ced5c60-4a6a-4b67-a8ad-c637b0ee1ef5 req-0ba12c68-cb26-4da5-9697-5f08940b6258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a3017f-73cc-4824-a620-0bc87d8181a5", "tag": "be5145df-9a81-462a-86a2-55023b825699"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:18.646236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-7ced5c60-4a6a-4b67-a8ad-c637b0ee1ef5 req-0ba12c68-cb26-4da5-9697-5f08940b6258 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:18.646758 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-7ced5c60-4a6a-4b67-a8ad-c637b0ee1ef5 req-0ba12c68-cb26-4da5-9697-5f08940b6258 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:18.658605 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-7ced5c60-4a6a-4b67-a8ad-c637b0ee1ef5 req-0ba12c68-cb26-4da5-9697-5f08940b6258 service nova] Creating event network-changed:be5145df-9a81-462a-86a2-55023b825699 for instance e7a3017f-73cc-4824-a620-0bc87d8181a5 on hv-cinder-81322 Jul 28 17:55:18.664513 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-7ced5c60-4a6a-4b67-a8ad-c637b0ee1ef5 req-0ba12c68-cb26-4da5-9697-5f08940b6258 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034812 Jul 28 17:55:18.665125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 554/1127] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:52.937953 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=7 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:52.938720 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=28 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:52.990153 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:52.990651 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:52.997067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:52.997538 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:52.998286 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:52.998712 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:53.021547 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-a0d33861-2659-4235-8310-a42cce653770 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/ips" status: 200 len: 151 microversion: 2.1 time: 0.088707 Jul 28 17:55:53.022092 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 574/1128] 10.222.0.89 () {58 vars in 1248 bytes} [Thu Jul 28 17:55:52 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:54.356449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=7 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:54.357218 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=22 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:54.361548 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beb00b54-9986-4da4-8c1f-9c0c03036d2a"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:54.363951 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:55:54.371515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:54.371962 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:54.372728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:55:54.373187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:55:54.644552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-eed9f058-3f03-4cd7-86b8-a70153a006e1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "POST /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289508 Jul 28 17:55:54.645629 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 555/1129] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:55:54 2022] POST /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:56:02.278853 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:02.279377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:02.286026 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:02.286474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:02.287244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:02.288261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:02.371756 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'services' on Instance uuid 97639f29-3303-412a-bfe8-ae245c93aeb3 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:56:02.443795 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e497128a-8831-41bc-8fb6-4e4442795e6f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments/beb00b54-9986-4da4-8c1f-9c0c03036d2a" status: 202 len: 0 microversion: 2.1 time: 0.169304 Jul 28 17:56:02.444441 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 575/1130] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:56:02 2022] DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments/beb00b54-9986-4da4-8c1f-9c0c03036d2a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:56:02.453901 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:02.456219 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:02.462976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:02.463472 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:02.464279 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:02.464761 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:02.499974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a1d1e81c-b387-4508-9561-372cac5da1c0 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050802 Jul 28 17:56:02.500557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 556/1131] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:56:02 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:56:03.514134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:03.516351 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:03.522631 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.523076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.523837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.524275 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.552687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-2e64e793-a887-461f-a54c-d72db0491b3b tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043637 Jul 28 17:56:03.553771 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 576/1132] 10.222.0.89 () {58 vars in 1302 bytes} [Thu Jul 28 17:56:03 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 17:56:03.615231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:03.616253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:03.623000 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.623445 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.624236 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.624692 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.650776 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:56:03.726752 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-53919aa6-d8ec-4a96-bdaf-5103a63865f8 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 204 len: 0 microversion: 2.1 time: 0.113991 Jul 28 17:56:03.727398 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 557/1133] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:56:03 2022] DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:56:03.735613 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:03.736250 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:03.742959 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.743403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.744167 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:03.744626 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:03.876865 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:03.885854 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c4a151f8-6a62-43a3-b752-abe4e9089fac tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1682 microversion: 2.1 time: 0.153992 Jul 28 17:56:03.886434 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 577/1134] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:03 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:04.908378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.909106 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:04.916669 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:04.917121 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:04.917921 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:04.918361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:05.048823 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:05.056525 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-9338e304-c245-4905-83de-e6ae2ddf4d0d tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1682 microversion: 2.1 time: 0.152344 Jul 28 17:56:05.057097 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 558/1135] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:04 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:06.077069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:06.077692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:06.084244 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:06.084792 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:06.086425 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:06.086854 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:06.219860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:06.228004 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-08d5bf53-85fe-4d8d-acb5-adae38428521 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1682 microversion: 2.1 time: 0.154833 Jul 28 17:56:06.228585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 578/1136] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:06 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:07.088661 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-6c2914fb-ebd7-417f-849d-ec14069903e8 req-4152adc5-7669-4912-a181-1a6e6a3480d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97639f29-3303-412a-bfe8-ae245c93aeb3", "name": "network-vif-deleted", "tag": "cd3e5d20-60d4-47f9-bfc5-f661a8ea28df"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:56:07.099238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6c2914fb-ebd7-417f-849d-ec14069903e8 req-4152adc5-7669-4912-a181-1a6e6a3480d5 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:07.099672 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6c2914fb-ebd7-417f-849d-ec14069903e8 req-4152adc5-7669-4912-a181-1a6e6a3480d5 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:07.113511 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-6c2914fb-ebd7-417f-849d-ec14069903e8 req-4152adc5-7669-4912-a181-1a6e6a3480d5 service nova] Creating event network-vif-deleted:cd3e5d20-60d4-47f9-bfc5-f661a8ea28df for instance 97639f29-3303-412a-bfe8-ae245c93aeb3 on hv-cinder-81322 Jul 28 17:56:07.119393 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-6c2914fb-ebd7-417f-849d-ec14069903e8 req-4152adc5-7669-4912-a181-1a6e6a3480d5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102736 Jul 28 17:56:07.120883 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 559/1137] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:56:07.250089 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:07.250737 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:07.257570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:07.258033 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:07.259208 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:07.259995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:07.295808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:07.296166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:07.296621 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lazy-loading 'fault' on Instance uuid 97639f29-3303-412a-bfe8-ae245c93aeb3 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:56:07.340866 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39ff02cba2fd4e7b9fb27b98b9daa82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a9ad9df4f84c658e9964f1a0c0b282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:07.349314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1cd012d5-b899-416c-9b13-cf49af9802f9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 200 len: 1331 microversion: 2.1 time: 0.103036 Jul 28 17:56:07.351739 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 579/1138] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:07 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:08.372198 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:08.373056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:08.379805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:08.380264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:08.381084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:08.381653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:08.402737 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 HTTP/1.1 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:56:08.404368 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:08.406132 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '97639f29-3303-412a-bfe8-ae245c93aeb3'} Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:08.407139 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:08.408785 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:08.410374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:08.410374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3fc866ae-2fc7-4911-b7ce-0b76b9891193 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 404 len: 111 microversion: 2.1 time: 0.037830 Jul 28 17:56:08.410374 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 560/1139] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:08 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:08.415808 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7a38e5f2-67c3-4cc3-903a-73af771e505a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '.version_select at 0x7fce39ffe670>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:08.435054 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7a38e5f2-67c3-4cc3-903a-73af771e505a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484019423" status: 202 len: 0 microversion: 2.1 time: 0.023736 Jul 28 17:56:08.435683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 580/1140] 10.222.0.89 () {58 vars in 1221 bytes} [Thu Jul 28 17:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484019423 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:56:10.174304 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:10.174838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:10.181805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:10.182256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:10.183033 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:10.183469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:10.197646 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 HTTP/1.1 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:56:10.199199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.200922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '97639f29-3303-412a-bfe8-ae245c93aeb3'} Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:10.202078 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.203656 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.205363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:10.205363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b86a9f8c-1e53-4e19-b150-84c3e82ac8cc tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 404 len: 111 microversion: 2.1 time: 0.030195 Jul 28 17:56:10.205363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 561/1141] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:56:10 2022] DELETE /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:10.209723 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:10.210337 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 97639f29-3303-412a-bfe8-ae245c93aeb3] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:10.216986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:10.217480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:10.218248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:10.218683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:10.232270 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 HTTP/1.1 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:56:10.233956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.235734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '97639f29-3303-412a-bfe8-ae245c93aeb3'} Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:10.236860 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. Jul 28 17:56:10.238499 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:10.239984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 97639f29-3303-412a-bfe8-ae245c93aeb3 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:10.239984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cc0b55ce-5935-4fea-a18f-5ca8a3d78da9 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3" status: 404 len: 111 microversion: 2.1 time: 0.030087 Jul 28 17:56:10.239984 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 581/1142] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:10 2022] GET /compute/v2.1/servers/97639f29-3303-412a-bfe8-ae245c93aeb3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:11.374783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:11.375272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:11.382597 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.383074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.383843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.384282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.398366 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d HTTP/1.1 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:56:11.399894 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.401685 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': '05d292fc-1ec6-4cd3-80a1-bf198ce23c9d'} Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:11.402509 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.403896 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.405233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:11.405233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-33390c4d-276d-47ee-b91e-8bcf437ef83f tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 404 len: 111 microversion: 2.1 time: 0.030591 Jul 28 17:56:11.405233 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 562/1143] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:56:11 2022] DELETE /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:56:11.410007 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:11.410652 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:11.417320 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.417775 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.418555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.418996 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.432301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d HTTP/1.1 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:56:11.433856 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.436758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '05d292fc-1ec6-4cd3-80a1-bf198ce23c9d'} Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:11.437733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. Jul 28 17:56:11.439222 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.440616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance 05d292fc-1ec6-4cd3-80a1-bf198ce23c9d could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:11.440616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-75afce87-4b07-43c8-95ab-d317bb105638 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d" status: 404 len: 111 microversion: 2.1 time: 0.029091 Jul 28 17:56:11.440616 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 582/1144] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:11 2022] GET /compute/v2.1/servers/05d292fc-1ec6-4cd3-80a1-bf198ce23c9d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 17:56:11.444240 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:11.444799 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:11.450840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.451285 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.452050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.452483 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.467039 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e HTTP/1.1 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:56:11.468596 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.470547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'bd39380c-a0c4-4d3d-9498-25198768009e'} Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:11.471584 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.473231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.474754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:11.474754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3a59c309-3629-4a63-be49-67d1cef5a0b1 tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 404 len: 111 microversion: 2.1 time: 0.030233 Jul 28 17:56:11.474754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 563/1145] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:56:11 2022] DELETE /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:11.483020 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:11.484159 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: bd39380c-a0c4-4d3d-9498-25198768009e] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:11.494784 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.495589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.496913 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:11.497725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:11.523732 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e HTTP/1.1 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:56:11.527078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.528822 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'bd39380c-a0c4-4d3d-9498-25198768009e'} Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:11.529805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. Jul 28 17:56:11.531400 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:11.532786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance bd39380c-a0c4-4d3d-9498-25198768009e could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:11.532786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1b024733-d41c-4fd5-bf07-7403e28244ea tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e" status: 404 len: 111 microversion: 2.1 time: 0.053697 Jul 28 17:56:11.532786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 583/1146] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:11 2022] GET /compute/v2.1/servers/bd39380c-a0c4-4d3d-9498-25198768009e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:12.675759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:12.676267 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:12.683708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:12.684165 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:12.684927 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:12.685399 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:12.699543 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 HTTP/1.1 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:56:12.701061 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.702751 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'db521d28-6a27-47cd-b764-156c113ed677'} Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:12.703706 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.705272 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.706855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:12.706855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-79206653-35c3-4d63-8861-706a7007ac2a tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 404 len: 111 microversion: 2.1 time: 0.030557 Jul 28 17:56:12.706855 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 564/1147] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:56:12 2022] DELETE /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:12.711283 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:12.711934 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] [instance: db521d28-6a27-47cd-b764-156c113ed677] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:12.718494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:12.718946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:12.719715 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:12.720151 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:12.735674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] HTTP exception thrown: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Request method failure captured: Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 HTTP/1.1 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4sxxuKuTmPLD5eNFSfZvSuet6GaFxYWaYX-zwx83Et7SRNpT03xjWYIwRazqGNSuI7ScVJrXdIy73C1g2QQxvo79Fu2v_lmQpmucDk79adHOG7wcAXek4TP3_QqFbdPdcG34s83gi3UZTrYH-t0EVE1w2TVIeUbJ298DECuWtvIn_XI Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:56:12.737267 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72a9ad9df4f84c658e9964f1a0c0b282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 72a9ad9df4f84c658e9964f1a0c0b282 Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-831035099 Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 39ff02cba2fd4e7b9fb27b98b9daa82e Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-AttachVolumeNegativeTest-831035099-project Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.738907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'db521d28-6a27-47cd-b764-156c113ed677'} Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:56:12.739904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. Jul 28 17:56:12.742166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:56:12.743543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] Returning 404 to user: Instance db521d28-6a27-47cd-b764-156c113ed677 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:56:12.743543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0a970c74-0bc2-4e18-b938-fce13e136e6e tempest-AttachVolumeNegativeTest-831035099 tempest-AttachVolumeNegativeTest-831035099-project] 10.222.0.89 "GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677" status: 404 len: 111 microversion: 2.1 time: 0.031413 Jul 28 17:56:12.743543 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 584/1148] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:12 2022] GET /compute/v2.1/servers/db521d28-6a27-47cd-b764-156c113ed677 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:56:41.977787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-944482960", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "networks": [{"uuid": "c3a6f3df-b84a-4785-96e4-3bfd4b74d770"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:56:41.986753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:41.987408 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:42.040197 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] validate_networks() for [('c3a6f3df-b84a-4785-96e4-3bfd4b74d770', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:56:42.431507 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:56:42.431930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:56:42.432403 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:56:42.432814 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:56:42.433247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:56:42.442125 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:42.443177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:42.444519 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:42.444957 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:42.463604 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Getting quotas for project 6ed3b5ffc1dd4fb9a814a967d1c9e8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:56:42.467657 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Getting quotas for user 2277cf311617495cb784285f328451c5 and project 6ed3b5ffc1dd4fb9a814a967d1c9e8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:56:42.479875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:56:42.482842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:56:42.533265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-25bd64c0-55bd-477e-8e53-6797aa4c1c10 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564381 Jul 28 17:56:42.533919 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 565/1149] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:56:42.545021 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-59ce6d80-8d8b-44ed-858f-77d3eb2c19b0 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:42.545666 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-59ce6d80-8d8b-44ed-858f-77d3eb2c19b0 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:42.547837 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:42.548497 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:42.606899 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-59ce6d80-8d8b-44ed-858f-77d3eb2c19b0 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:42.613749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-59ce6d80-8d8b-44ed-858f-77d3eb2c19b0 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1218 microversion: 2.1 time: 0.072690 Jul 28 17:56:42.614323 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 585/1150] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:42 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:43.635102 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:43.635794 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:43.642114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:43.642567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:43.643350 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:43.643795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:43.743143 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:43.752922 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3f4f9219-2b89-4296-9fc3-05a306904b56 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1278 microversion: 2.1 time: 0.122735 Jul 28 17:56:43.753876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 566/1151] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:43 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:44.776227 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:44.776838 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:44.783646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:44.784117 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:44.784880 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:44.785354 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:44.936130 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:44.944184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-da4f25df-99e0-474e-87bf-f5ba998794a1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.172547 Jul 28 17:56:44.944764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 586/1152] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:44 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:45.040955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-9062d6ba-791b-40a5-8c61-d25fd9e1e156 req-51652ebb-9a75-4c5e-a4f6-00d3995f2b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10395ba4-1ef2-4d54-a861-de51330d1b3a", "tag": "75d4c997-1dd7-45bf-b745-3e38681db406"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:56:45.052337 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-9062d6ba-791b-40a5-8c61-d25fd9e1e156 req-51652ebb-9a75-4c5e-a4f6-00d3995f2b56 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:45.052783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-9062d6ba-791b-40a5-8c61-d25fd9e1e156 req-51652ebb-9a75-4c5e-a4f6-00d3995f2b56 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:45.064077 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-9062d6ba-791b-40a5-8c61-d25fd9e1e156 req-51652ebb-9a75-4c5e-a4f6-00d3995f2b56 service nova] Creating event network-changed:75d4c997-1dd7-45bf-b745-3e38681db406 for instance 10395ba4-1ef2-4d54-a861-de51330d1b3a on hv-cinder-81322 Jul 28 17:56:45.069045 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-9062d6ba-791b-40a5-8c61-d25fd9e1e156 req-51652ebb-9a75-4c5e-a4f6-00d3995f2b56 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032785 Jul 28 17:56:45.069744 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 567/1153] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:56:45.966343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:45.967114 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:45.973917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:45.974402 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:45.975874 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:45.976328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:46.109123 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:46.117135 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1dfae82a-2095-4541-8f8a-3c3a296535b3 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.155317 Jul 28 17:56:46.117755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 587/1154] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:45 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:47.138754 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:47.139488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:47.145775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:47.146222 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:47.146989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:47.147932 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:47.279200 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:47.286731 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-389af6ab-8ccc-4041-b03e-eb19640d0e27 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.152730 Jul 28 17:56:47.287297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 568/1155] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:47 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:48.308097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:48.308743 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:48.315542 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:48.315995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:48.316805 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:48.317268 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:48.456257 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:48.464518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-9af5c315-039a-44d1-87f6-117db1afed28 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.160214 Jul 28 17:56:48.477225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 588/1156] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:48 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:49.485889 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:49.486488 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:49.493306 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:49.493756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:49.494518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:49.494955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:49.630184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:49.638114 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-af864afe-70e5-4bd1-a029-3cf342df2c40 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.156079 Jul 28 17:56:49.638678 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 569/1157] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:49 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:50.599408 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-f61f1727-6268-49ce-8f82-000db6b32791 req-27d470ea-6239-4fc5-8dc8-6b9254fab1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10395ba4-1ef2-4d54-a861-de51330d1b3a", "name": "network-vif-plugged", "status": "completed", "tag": "75d4c997-1dd7-45bf-b745-3e38681db406"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:56:50.609545 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-f61f1727-6268-49ce-8f82-000db6b32791 req-27d470ea-6239-4fc5-8dc8-6b9254fab1b3 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:50.609990 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-f61f1727-6268-49ce-8f82-000db6b32791 req-27d470ea-6239-4fc5-8dc8-6b9254fab1b3 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:50.621375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-f61f1727-6268-49ce-8f82-000db6b32791 req-27d470ea-6239-4fc5-8dc8-6b9254fab1b3 service nova] Creating event network-vif-plugged:75d4c997-1dd7-45bf-b745-3e38681db406 for instance 10395ba4-1ef2-4d54-a861-de51330d1b3a on hv-cinder-81322 Jul 28 17:56:50.626254 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-f61f1727-6268-49ce-8f82-000db6b32791 req-27d470ea-6239-4fc5-8dc8-6b9254fab1b3 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151720 Jul 28 17:56:50.626826 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 589/1158] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:56:50.659899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:50.660514 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:50.667554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:50.668006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:50.668779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:50.669898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:50.805270 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:50.813535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-309c6a36-e105-4924-ad85-74a877ec9931 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.157444 Jul 28 17:56:50.814126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 570/1159] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:50 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:51.835383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:51.836084 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:51.842401 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:51.842852 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:51.843615 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:51.844051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:51.974793 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:51.982461 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-09c61932-5b8d-435c-bc9b-ed6ee97d52d9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1318 microversion: 2.1 time: 0.151855 Jul 28 17:56:51.983032 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 590/1160] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:51 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:53.003243 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:53.003881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:56:53.006295 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:53.007515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:53.013170 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:53.013729 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:53.014385 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:56:53.014809 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:56:53.146095 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:56:53.154518 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-46527faf-0aea-4b99-99ea-494b22f0b954 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1507 microversion: 2.1 time: 0.155206 Jul 28 17:56:53.155094 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 571/1161] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:56:52 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:09.425248 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc912a43-5cb8-4c95-b063-252ba650eaed", "device": "/dev/sdb"}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:09.428303 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:09.430368 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:09.431272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=14 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:09.431924 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=26 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:09.439396 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:09.439847 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:09.440627 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:09.441061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:09.704453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bcca81ce-1270-47bd-98b0-c34cb6b551f2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "POST /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283273 Jul 28 17:57:09.705057 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 591/1162] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:57:09 2022] POST /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:17.354307 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:17.354881 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:17.356875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:17.357803 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=34 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:17.363959 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:17.364406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:17.365199 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:17.365637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:17.394996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:57:17.490572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-d01e8c82-3151-4b9f-8f99-ad2e3187510d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "DELETE /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 204 len: 0 microversion: 2.1 time: 0.140621 Jul 28 17:57:17.491167 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 572/1163] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:57:17 2022] DELETE /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:57:17.500343 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:17.501074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:17.507657 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:17.508475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:17.509296 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:17.509741 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:17.649763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:17.658798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d3898265-dca3-4cbd-b130-263b27af7ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1573 microversion: 2.1 time: 0.163111 Jul 28 17:57:17.659371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 592/1164] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:17 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:18.681606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:18.682320 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:18.688890 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:18.689369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:18.690126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:18.690603 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:18.822575 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:18.830302 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-25f13b6e-53c9-4966-802c-d2a24a68d338 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1573 microversion: 2.1 time: 0.153740 Jul 28 17:57:18.830653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 573/1165] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:18 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:19.853457 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:19.854061 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:19.860735 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:19.861182 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:19.861952 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:19.862379 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:19.997228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:20.004728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fa88fcb8-5429-41d3-9526-a1d34a7b8f1f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1573 microversion: 2.1 time: 0.156134 Jul 28 17:57:20.005330 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 593/1166] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:19 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:21.026960 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:21.027573 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:21.034072 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:21.034521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:21.035285 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:21.035718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:21.173012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:21.180677 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-5afc7ad5-d97c-43ce-bd1e-dc6026fdda5d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1573 microversion: 2.1 time: 0.158564 Jul 28 17:57:21.181263 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 574/1167] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:21 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:22.191166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-b56e0daf-e01c-475a-85a2-7a7ba4e878d7 req-b3d67995-6c86-4995-9985-9b85cf4a5c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a3017f-73cc-4824-a620-0bc87d8181a5", "name": "network-vif-deleted", "tag": "be5145df-9a81-462a-86a2-55023b825699"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:22.202829 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:22.203524 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:22.216164 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:22.216843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:22.220759 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:22.220918 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-b56e0daf-e01c-475a-85a2-7a7ba4e878d7 req-b3d67995-6c86-4995-9985-9b85cf4a5c66 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:22.221322 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-b56e0daf-e01c-475a-85a2-7a7ba4e878d7 req-b3d67995-6c86-4995-9985-9b85cf4a5c66 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:22.225093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:22.235725 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-b56e0daf-e01c-475a-85a2-7a7ba4e878d7 req-b3d67995-6c86-4995-9985-9b85cf4a5c66 service nova] Creating event network-vif-deleted:be5145df-9a81-462a-86a2-55023b825699 for instance e7a3017f-73cc-4824-a620-0bc87d8181a5 on hv-cinder-81322 Jul 28 17:57:22.241048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-b56e0daf-e01c-475a-85a2-7a7ba4e878d7 req-b3d67995-6c86-4995-9985-9b85cf4a5c66 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053596 Jul 28 17:57:22.242699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 594/1168] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:22.302522 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:22.311813 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b7c8a0e9-2de3-4641-9c72-b353cafa59a0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1508 microversion: 2.1 time: 0.113331 Jul 28 17:57:22.312400 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 575/1169] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:22 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1508 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:23.335495 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:23.336201 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:23.343262 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:23.343703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:23.344455 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:23.344886 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:23.408238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:23.416181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-37d54b7f-4d7e-4f33-a4ae-0556584129c8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1508 microversion: 2.1 time: 0.085400 Jul 28 17:57:23.416766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 595/1170] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:23 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1508 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:24.437843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:24.438441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:24.444448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:24.444898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:24.445688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:24.446126 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:24.506554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:24.514372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-af93f8e7-baf4-438d-bc58-ad9e5b284227 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1225 microversion: 2.1 time: 0.080621 Jul 28 17:57:24.514936 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 576/1171] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:24 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:25.536005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:25.536582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:25.543583 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:25.544016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:25.544774 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:25.545233 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:25.576482 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:25.576927 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:25.577403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lazy-loading 'fault' on Instance uuid e7a3017f-73cc-4824-a620-0bc87d8181a5 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:57:25.618173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:25.625786 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-77597f6d-d204-4456-b105-f30a215a1ef5 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 200 len: 1230 microversion: 2.1 time: 0.093699 Jul 28 17:57:25.626361 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 596/1172] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:25 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:26.646958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:26.648234 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:26.656187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:26.656671 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:26.657490 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:26.657931 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:26.671628 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] HTTP exception thrown: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Request method failure captured: Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 HTTP/1.1 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4s1b7D0TqThtayJ9ARWtYHOlqi_Ap0lckG2bNEF-cgOwcKGEiNwFoVacLPoXIUbylIJFOpKS7qVstjeX1QPZ0JSdr6tvwpAVqiTLMMuHHR3sBdCfE2FWGq1-SxAFifE6GsynVFvCmyGfpyZtH8nvmATFpVZ6dbJa7u6jFg-y3SYMTmQ Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 17:57:26.673341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-TestVolumeBootPattern-1149748701 Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-TestVolumeBootPattern-1149748701-project Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: c4618ca07ce2408ba90e9eaab0b940c9 Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-TestVolumeBootPattern-1149748701-project Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 17:57:26.675141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'e7a3017f-73cc-4824-a620-0bc87d8181a5'} Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:57:26.676195 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 17:57:26.677728 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 17:57:26.679010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Returning 404 to user: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:57:26.679010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8433e81d-bc00-4b5d-a07c-3754f801f1f7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 404 len: 111 microversion: 2.1 time: 0.031708 Jul 28 17:57:26.679010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 577/1173] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:26 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:26.773173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1747666569", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858831229", "security_groups": [{"name": "tempest-secgroup-smoke-1200150"}], "block_device_mapping_v2": [{"uuid": "121db463-0aed-470f-95a7-a54a75f13b43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41cb40d0-5f53-4baf-b3ce-649cb31f7aff"}]}} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:26.893238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.network.neutron [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] validate_networks() for [('41cb40d0-5f53-4baf-b3ce-649cb31f7aff', None, None, None, None, None)] {{(pid=124515) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:57:27.324353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:57:27.324761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image limits 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:57:27.325276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:57:27.325686 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image pref 0:0:0 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:57:27.326128 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.virt.hardware [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:57:27.335139 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:27.335710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:27.336518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:27.336957 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:27.354123 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:57:27.358132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.quota [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for user c4618ca07ce2408ba90e9eaab0b940c9 and project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124515) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:57:27.417328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Going to run 1 instances... {{(pid=124515) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:57:27.419398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='121db463-0aed-470f-95a7-a54a75f13b43',volume_size=None,volume_type=None)] {{(pid=124515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:57:27.549435 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-86cf76c3-b4ef-4213-92d7-cade22f40f16 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.780615 Jul 28 17:57:27.550079 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 597/1174] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:57:26 2022] POST /compute/v2.1/servers => generated 403 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 17:57:27.560933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-91c5f64d-ad04-4a86-bf86-85e598408580 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:27.561567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-91c5f64d-ad04-4a86-bf86-85e598408580 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:27.614820 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-91c5f64d-ad04-4a86-bf86-85e598408580 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:27.621851 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-91c5f64d-ad04-4a86-bf86-85e598408580 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1094 microversion: 2.1 time: 0.064704 Jul 28 17:57:27.622430 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 578/1175] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:27 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:28.643928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:28.644565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:28.651641 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:28.652338 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:28.653459 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:28.653895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:28.717585 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:28.725067 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-35ea0a13-e468-4ee9-aaaf-47fa9abacdcf tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1144 microversion: 2.1 time: 0.085615 Jul 28 17:57:28.726410 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 598/1176] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:28 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:29.746349 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:29.746954 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:29.754251 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:29.754704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:29.755464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:29.755899 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:29.816471 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:29.824960 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-7b3f87e0-8b3d-4d23-a018-cc57854c5864 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1192 microversion: 2.1 time: 0.082428 Jul 28 17:57:29.825555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 579/1177] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:29 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:30.846875 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:30.848397 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:30.856872 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:30.857348 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:30.858321 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:30.858757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:31.025088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:31.034014 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4c6bcd4a-1526-416b-85a0-9790b8195fb3 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1275 microversion: 2.1 time: 0.191078 Jul 28 17:57:31.035844 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 599/1178] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:30 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:31.762521 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-4f38853b-8927-42ad-a6d2-4449c18bc50d req-2632d1f4-52de-4c59-8a80-7584602109f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc646c95-2b66-46b9-94d8-df973d9160fc", "tag": "3bf83eb7-bb7a-49cc-836d-ab20bf06936c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:31.775116 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4f38853b-8927-42ad-a6d2-4449c18bc50d req-2632d1f4-52de-4c59-8a80-7584602109f1 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:31.775846 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-4f38853b-8927-42ad-a6d2-4449c18bc50d req-2632d1f4-52de-4c59-8a80-7584602109f1 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:31.793141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-4f38853b-8927-42ad-a6d2-4449c18bc50d req-2632d1f4-52de-4c59-8a80-7584602109f1 service nova] Creating event network-changed:3bf83eb7-bb7a-49cc-836d-ab20bf06936c for instance cc646c95-2b66-46b9-94d8-df973d9160fc on hv-cinder-81322 Jul 28 17:57:31.798606 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-4f38853b-8927-42ad-a6d2-4449c18bc50d req-2632d1f4-52de-4c59-8a80-7584602109f1 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040300 Jul 28 17:57:31.799429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 580/1179] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:32.056518 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:32.057484 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:32.064595 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:32.065038 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:32.065862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:32.066290 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:32.207266 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:32.216175 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0db1e916-4854-4ba5-8f00-ff850a6926e2 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.164112 Jul 28 17:57:32.217005 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 600/1180] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:32 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:33.239572 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:33.240271 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:33.248096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:33.248545 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:33.249341 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:33.249777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:33.386278 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:33.393976 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3713608a-610f-4679-8f7f-7cbf4a5ad5f8 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.159049 Jul 28 17:57:33.394547 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 581/1181] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:33 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:33.488674 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:33.489227 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:33.498496 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:33.499169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:33.500395 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:33.501053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:33.584815 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lazy-loading 'services' on Instance uuid 10395ba4-1ef2-4d54-a861-de51330d1b3a {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:57:33.656555 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-12480453-da1c-4333-88ca-4f6885e5e83e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "DELETE /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a/os-volume_attachments/cc912a43-5cb8-4c95-b063-252ba650eaed" status: 202 len: 0 microversion: 2.1 time: 0.171627 Jul 28 17:57:33.657172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 601/1182] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:57:33 2022] DELETE /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a/os-volume_attachments/cc912a43-5cb8-4c95-b063-252ba650eaed => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:57:34.415011 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:34.415624 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:34.422280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.422732 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:34.423505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.423943 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:34.560439 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:34.568161 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-880cb1c4-695b-4f2b-b08a-5c638c9c214c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.157104 Jul 28 17:57:34.568730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 582/1183] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:34 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:34.780811 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:34.781456 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:34.788904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.789394 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:34.790166 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.790601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:34.816264 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:57:34.894752 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e26a8b19-7ede-4747-b29c-7fb6c09fbaa5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "DELETE /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 204 len: 0 microversion: 2.1 time: 0.117988 Jul 28 17:57:34.895375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 602/1184] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:57:34 2022] DELETE /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:57:34.904010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:34.904626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:34.910782 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.911425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:34.912383 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:34.913545 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:35.046468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:35.054316 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a44d6017-ff4d-4cb9-a25b-643259a89e43 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1513 microversion: 2.1 time: 0.154396 Jul 28 17:57:35.054906 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 583/1185] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:34 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:35.592000 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:35.592683 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:35.598684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:35.599172 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:35.599925 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:35.600403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:35.733134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:35.741491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-abf71f35-baa4-4539-ab12-430e78c08b67 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.153161 Jul 28 17:57:35.742147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 603/1186] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:35 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:36.076081 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:36.076699 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:36.083282 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:36.083730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:36.084532 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:36.085265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:36.221396 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:36.229566 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2ce79194-359a-40d2-98ad-59ccfef2839b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1513 microversion: 2.1 time: 0.157302 Jul 28 17:57:36.230134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 584/1187] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:36 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:36.763931 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:36.764537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:36.771183 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:36.771630 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:36.772958 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:36.773418 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:36.913377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:36.916850 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:36.921708 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ecfa5bfd-1764-4e45-9461-23de5d616c4e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.161625 Jul 28 17:57:36.922279 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 604/1188] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:36 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:37.251631 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:37.252300 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:37.259567 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:37.260031 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:37.260809 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:37.261290 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:37.447925 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:37.455370 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-96a287e6-fdeb-4e65-b1d6-07d883142ec5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1513 microversion: 2.1 time: 0.207530 Jul 28 17:57:37.455941 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 585/1189] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:37 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:37.588023 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-f6a5e75c-e234-4604-b4d8-5c9c88283600 req-69143c81-6a79-4562-8da8-af06b7da796c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10395ba4-1ef2-4d54-a861-de51330d1b3a", "name": "network-vif-deleted", "tag": "75d4c997-1dd7-45bf-b745-3e38681db406"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:37.593588 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:37.594261 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=6 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:37.602474 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-f6a5e75c-e234-4604-b4d8-5c9c88283600 req-69143c81-6a79-4562-8da8-af06b7da796c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:37.602906 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-f6a5e75c-e234-4604-b4d8-5c9c88283600 req-69143c81-6a79-4562-8da8-af06b7da796c service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:37.614362 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-f6a5e75c-e234-4604-b4d8-5c9c88283600 req-69143c81-6a79-4562-8da8-af06b7da796c service nova] Creating event network-vif-deleted:75d4c997-1dd7-45bf-b745-3e38681db406 for instance 10395ba4-1ef2-4d54-a861-de51330d1b3a on hv-cinder-81322 Jul 28 17:57:37.621535 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-f6a5e75c-e234-4604-b4d8-5c9c88283600 req-69143c81-6a79-4562-8da8-af06b7da796c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038471 Jul 28 17:57:37.622147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 605/1190] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:37.942012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:37.942618 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:37.944844 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:37.950419 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:37.950909 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:37.951676 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:37.952109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:38.088354 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:38.095841 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-dc59e746-3e63-473f-b26b-24db4b98e940 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.157701 Jul 28 17:57:38.096406 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 586/1191] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:37 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:38.478467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:38.479075 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:38.486566 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:38.487013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:38.488334 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:38.488769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:38.521184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:38.521646 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:38.522728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lazy-loading 'fault' on Instance uuid 10395ba4-1ef2-4d54-a861-de51330d1b3a {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:57:38.564173 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:38.572453 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-682f3f58-9854-4f84-a5db-042417dd9831 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 200 len: 1308 microversion: 2.1 time: 0.100138 Jul 28 17:57:38.573031 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 606/1192] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:38 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:39.119022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:39.119665 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:39.126607 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:39.127052 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:39.127818 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:39.128247 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:39.275498 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:39.283238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b12af545-1b31-430a-9d47-27e5dc4c4a8f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.169461 Jul 28 17:57:39.283821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 587/1193] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:39 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:39.594123 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:39.594745 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 10395ba4-1ef2-4d54-a861-de51330d1b3a] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:39.597210 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:39.603684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:39.604128 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:39.604877 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:39.605359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:39.620640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] HTTP exception thrown: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Request method failure captured: Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a HTTP/1.1 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4s3YqKj_-ORTsmlI1aWJ4qf2Kk_-SGMRdKD0t_1lubhM69wEfwsy5K8TQKYJWt3wTLSjWJN_gh7wHsEinHMfv7Q5JcKkW-VhAhVYSbZfNX6BCZO_33UY6Zmd7A7Mqk1g2ES7zz7xLfYs1QL0Z2vU2x1WyuK25E3r0SzUx3yPcl0ZhV0 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 6ed3b5ffc1dd4fb9a814a967d1c9e8dc Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:57:39.622291 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 6ed3b5ffc1dd4fb9a814a967d1c9e8dc Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotTestJSON-835545257-project Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 2277cf311617495cb784285f328451c5 Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotTestJSON-835545257-project Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. Jul 28 17:57:39.624165 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '10395ba4-1ef2-4d54-a861-de51330d1b3a'} Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:57:39.625091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. Jul 28 17:57:39.626650 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:57:39.627919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Returning 404 to user: Instance 10395ba4-1ef2-4d54-a861-de51330d1b3a could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:57:39.627919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-0e97b520-136b-45d3-8756-b61d4a28a5e9 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a" status: 404 len: 111 microversion: 2.1 time: 0.033457 Jul 28 17:57:39.627919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 607/1194] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:39 2022] GET /compute/v2.1/servers/10395ba4-1ef2-4d54-a861-de51330d1b3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:40.306155 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:40.306934 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:40.313325 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:40.313779 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:40.314554 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:40.314997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:40.446469 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:40.454347 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cefb10a6-ba0e-479e-8cee-563722100775 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.152737 Jul 28 17:57:40.454945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 588/1195] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:40 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:41.476281 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:41.476912 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:41.483789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:41.484272 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:41.485059 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:41.485549 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:41.619589 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:41.627088 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-aa6bd62d-4c5a-45b9-a7a3-1caa029a0134 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.155026 Jul 28 17:57:41.627642 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 608/1196] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:41 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:42.648557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:42.649187 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:42.656689 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:42.657177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:42.658043 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:42.658555 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:42.663626 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:42.795023 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:42.804012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4b5b2c1c-6612-4bdf-8cf0-2bd0e1210b30 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.159119 Jul 28 17:57:42.804649 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 589/1197] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:42 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:43.297491 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-0fdeb36b-4e62-425f-99b5-fc1eb15b770c req-eb12d174-0e63-4cfa-a29c-770d4356730e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc646c95-2b66-46b9-94d8-df973d9160fc", "name": "network-vif-plugged", "status": "completed", "tag": "3bf83eb7-bb7a-49cc-836d-ab20bf06936c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:43.311415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0fdeb36b-4e62-425f-99b5-fc1eb15b770c req-eb12d174-0e63-4cfa-a29c-770d4356730e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:43.312097 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-0fdeb36b-4e62-425f-99b5-fc1eb15b770c req-eb12d174-0e63-4cfa-a29c-770d4356730e service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:43.330513 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-0fdeb36b-4e62-425f-99b5-fc1eb15b770c req-eb12d174-0e63-4cfa-a29c-770d4356730e service nova] Creating event network-vif-plugged:3bf83eb7-bb7a-49cc-836d-ab20bf06936c for instance cc646c95-2b66-46b9-94d8-df973d9160fc on hv-cinder-81322 Jul 28 17:57:43.340687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-0fdeb36b-4e62-425f-99b5-fc1eb15b770c req-eb12d174-0e63-4cfa-a29c-770d4356730e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047113 Jul 28 17:57:43.341389 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 609/1198] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:43.824013 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:43.824726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:43.831353 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:43.831797 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:43.832557 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:43.832985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:43.967168 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:43.974565 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-3e7f120b-5362-41b6-9d8f-22e79585503e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.154428 Jul 28 17:57:43.975769 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 590/1199] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:43 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:44.996904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:44.997623 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:45.004424 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:45.004869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:45.005676 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:45.006761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:45.141894 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:45.149563 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-89d6bd4e-9060-4d4a-8299-2a9007c40353 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.156850 Jul 28 17:57:45.150391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 610/1200] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:44 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:46.171340 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:46.171902 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:46.179561 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:46.180129 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:46.180917 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:46.181392 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:46.316573 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:46.324436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1c17283f-6132-42d0-8767-be6da035532d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.156995 Jul 28 17:57:46.325012 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 591/1201] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:46 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:47.346126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:47.346733 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:47.354998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:47.354998 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:47.355297 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:47.355726 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:47.489776 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:47.498046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-f94a797b-6df3-46a0-838a-3355df304365 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1263 microversion: 2.1 time: 0.155797 Jul 28 17:57:47.498645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 611/1202] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:47 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:48.469530 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-160668397", "imageRef": "2c4da321-cdfd-4e79-9290-67174866e427", "flavorRef": "452", "networks": [{"uuid": "c3a6f3df-b84a-4785-96e4-3bfd4b74d770"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:48.478842 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:48.518467 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:48.519068 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:48.524312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] validate_networks() for [('c3a6f3df-b84a-4785-96e4-3bfd4b74d770', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:57:48.527448 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.527904 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.528688 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.529207 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.672277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:48.682487 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-e4ca6054-0fc9-4cc1-846c-b729508eead7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1449 microversion: 2.1 time: 0.167651 Jul 28 17:57:48.683074 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 612/1203] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:48 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:57:48.704085 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:48.704734 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:48.711779 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.712432 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.713226 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.713665 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.858769 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:48.866360 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-5614b336-46b0-412c-a067-36c1223001d7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1449 microversion: 2.1 time: 0.166106 Jul 28 17:57:48.866946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 613/1204] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:48 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:57:48.886559 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:57:48.886961 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:57:48.887385 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:57:48.887831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:57:48.888207 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:57:48.897244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.898256 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.899220 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:48.899923 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:48.917028 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Getting quotas for project 6ed3b5ffc1dd4fb9a814a967d1c9e8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:57:48.921046 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Getting quotas for user 2277cf311617495cb784285f328451c5 and project 6ed3b5ffc1dd4fb9a814a967d1c9e8dc. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:57:48.933483 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:57:48.935738 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c4da321-cdfd-4e79-9290-67174866e427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:57:48.987765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-cca107d0-1687-4fbe-8420-d7fb08b55d36 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521888 Jul 28 17:57:48.988326 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 592/1205] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:57:49.000247 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d4a9e306-864f-4c66-9676-e4b2b44dc33d tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:49.001193 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d4a9e306-864f-4c66-9676-e4b2b44dc33d tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:49.072923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d4a9e306-864f-4c66-9676-e4b2b44dc33d tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:49.080421 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d4a9e306-864f-4c66-9676-e4b2b44dc33d tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1218 microversion: 2.1 time: 0.083930 Jul 28 17:57:49.081464 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 614/1206] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:48 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:50.103389 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:50.104056 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:50.112010 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:50.112710 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:50.113755 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:50.114378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:50.198064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:50.209224 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-749f4650-1cba-4a66-ae44-edf98c4b5921 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1278 microversion: 2.1 time: 0.109900 Jul 28 17:57:50.211117 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 593/1207] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:50 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:50.920317 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-e27ad94e-c9b2-41be-ad24-1746ceb91e70 req-3adb356a-2685-411a-980f-0a029b948024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc646c95-2b66-46b9-94d8-df973d9160fc", "tag": "3bf83eb7-bb7a-49cc-836d-ab20bf06936c"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:50.932923 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e27ad94e-c9b2-41be-ad24-1746ceb91e70 req-3adb356a-2685-411a-980f-0a029b948024 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:50.933793 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-e27ad94e-c9b2-41be-ad24-1746ceb91e70 req-3adb356a-2685-411a-980f-0a029b948024 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:50.945684 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-e27ad94e-c9b2-41be-ad24-1746ceb91e70 req-3adb356a-2685-411a-980f-0a029b948024 service nova] Creating event network-changed:3bf83eb7-bb7a-49cc-836d-ab20bf06936c for instance cc646c95-2b66-46b9-94d8-df973d9160fc on hv-cinder-81322 Jul 28 17:57:50.951480 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-e27ad94e-c9b2-41be-ad24-1746ceb91e70 req-3adb356a-2685-411a-980f-0a029b948024 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095809 Jul 28 17:57:50.955348 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 615/1208] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:51.233297 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:51.233949 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:51.242501 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:51.243449 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:51.244418 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:51.245323 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:51.564515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:51.572697 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-efcde301-fa17-4aa8-9691-c83eb1784063 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.343535 Jul 28 17:57:51.573589 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 594/1209] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:51 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:52.028791 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-6e6891f0-9d1b-4e18-84a8-97e428a8b28d req-6d990dd9-2508-41fd-9fed-c0b29cb88920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014d00f1-3a3a-43fa-b900-c1c9024ff502", "tag": "2d9c906e-f05b-459d-b9b8-a1edfbf137b9"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:52.042773 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-6e6891f0-9d1b-4e18-84a8-97e428a8b28d req-6d990dd9-2508-41fd-9fed-c0b29cb88920 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:52.043223 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-6e6891f0-9d1b-4e18-84a8-97e428a8b28d req-6d990dd9-2508-41fd-9fed-c0b29cb88920 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:52.055126 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-6e6891f0-9d1b-4e18-84a8-97e428a8b28d req-6d990dd9-2508-41fd-9fed-c0b29cb88920 service nova] Creating event network-changed:2d9c906e-f05b-459d-b9b8-a1edfbf137b9 for instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 on hv-cinder-81322 Jul 28 17:57:52.061353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-6e6891f0-9d1b-4e18-84a8-97e428a8b28d req-6d990dd9-2508-41fd-9fed-c0b29cb88920 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044000 Jul 28 17:57:52.062016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 616/1210] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:52.594643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:52.595372 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:52.602989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:52.603551 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:52.604416 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:52.604930 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:52.798840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:52.807291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a062421e-189d-401e-bd5b-7de13774d13e tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.216485 Jul 28 17:57:52.807955 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 595/1211] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:52 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:53.829682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:53.830694 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:53.836825 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:53.837299 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:53.838069 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:53.838498 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:53.970169 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:53.978420 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-1c07534f-fcdf-47fb-80dc-d1336a40870c tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.153395 Jul 28 17:57:53.978995 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 617/1212] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:53 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:54.999643 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:55.000238 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:55.006552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:55.007589 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:55.008361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:55.008795 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:55.143765 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:55.152210 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-4b902caa-1dd4-4433-85ea-4d6716a07f71 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.156463 Jul 28 17:57:55.152777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 596/1213] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:54 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:57:56.173851 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:56.174448 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:56.181132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:56.181608 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:56.182377 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:56.182810 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:56.314645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:56.324890 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-71bc478e-fbbf-44a6-bfe5-7fd896ab7e2b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.154955 Jul 28 17:57:56.325692 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 618/1214] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:56 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:57.345006 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-6674627d-33f1-41f8-91db-237068b0f23f req-c780b026-d54b-4c82-a681-c193a6174c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d00f1-3a3a-43fa-b900-c1c9024ff502", "name": "network-vif-plugged", "status": "completed", "tag": "2d9c906e-f05b-459d-b9b8-a1edfbf137b9"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:57.346761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:57.347383 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:57.354909 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:57.355369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:57.356152 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:57.356591 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:57.357882 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6674627d-33f1-41f8-91db-237068b0f23f req-c780b026-d54b-4c82-a681-c193a6174c67 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:57.358338 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-6674627d-33f1-41f8-91db-237068b0f23f req-c780b026-d54b-4c82-a681-c193a6174c67 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:57.371138 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-6674627d-33f1-41f8-91db-237068b0f23f req-c780b026-d54b-4c82-a681-c193a6174c67 service nova] Creating event network-vif-plugged:2d9c906e-f05b-459d-b9b8-a1edfbf137b9 for instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 on hv-cinder-81322 Jul 28 17:57:57.378898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-6674627d-33f1-41f8-91db-237068b0f23f req-c780b026-d54b-4c82-a681-c193a6174c67 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Jul 28 17:57:57.380216 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 597/1215] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:57:57.498345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:57.506369 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-b5e8b57c-d3cd-4088-8362-3471c666b8c2 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.163375 Jul 28 17:57:57.506983 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 619/1216] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:57 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:57:58.529833 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:58.530682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:58.537682 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:58.538595 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:58.539378 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:58.539807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:58.670988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:58.679052 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-951770c4-b30c-4815-a030-c5c6727668b1 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1318 microversion: 2.1 time: 0.152725 Jul 28 17:57:58.679993 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 598/1217] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:58 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:59.700815 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:57:59.701416 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:59.703966 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:59.709276 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:59.710525 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:59.711509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:59.711937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:59.845971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:57:59.855635 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7f9677f0-e53b-4b68-a99b-7d7c1eee8e22 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1507 microversion: 2.1 time: 0.158521 Jul 28 17:57:59.856228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 620/1218] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:57:59 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:57:59.877291 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284a439a-bbb7-42d4-bc5e-78dcdd7212ed", "device": "/dev/sdb"}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:57:59.882420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:57:59.885898 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:59.886996 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:59.894637 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:59.895093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:57:59.895876 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:57:59.896317 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:00.161715 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-8ab34b0e-e267-40b2-b2a7-797162f26b5a tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "POST /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288241 Jul 28 17:58:00.162335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 599/1219] 10.222.0.89 () {60 vars in 1323 bytes} [Thu Jul 28 17:57:59 2022] POST /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:58:19.572967 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:19.573570 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:19.575604 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=29 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:19.576301 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=72 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:19.582150 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:19.582601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:19.583359 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:19.583789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:19.669370 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.objects.instance [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lazy-loading 'services' on Instance uuid 014d00f1-3a3a-43fa-b900-c1c9024ff502 {{(pid=124515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 17:58:19.745184 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-ad96cd90-394f-4a9b-abff-dcbb949fff6b tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "DELETE /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502/os-volume_attachments/284a439a-bbb7-42d4-bc5e-78dcdd7212ed" status: 202 len: 0 microversion: 2.1 time: 0.176575 Jul 28 17:58:19.745789 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 621/1220] 10.222.0.89 () {58 vars in 1416 bytes} [Thu Jul 28 17:58:19 2022] DELETE /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502/os-volume_attachments/284a439a-bbb7-42d4-bc5e-78dcdd7212ed => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 17:58:20.867775 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:20.868668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:20.873045 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:20.873653 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:20.882886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:20.883335 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:20.884096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:20.884528 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:20.912963 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Going to try to terminate instance {{(pid=124516) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 17:58:20.987977 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-0099dd35-5794-4b74-9603-dd063da809ff tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "DELETE /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 204 len: 0 microversion: 2.1 time: 0.121653 Jul 28 17:58:20.988494 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 600/1221] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 17:58:20 2022] DELETE /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 17:58:20.999100 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:20.999798 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:21.006050 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:21.006493 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:21.007828 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:21.008450 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:21.137770 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:58:21.145327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-75647955-f16b-462e-aaa2-50e68c1fe6b5 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1513 microversion: 2.1 time: 0.151266 Jul 28 17:58:21.145900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 622/1222] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:58:20 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:58:22.168119 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:22.168742 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:22.175261 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:22.175705 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:22.176497 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:22.176931 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:22.310668 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:58:22.318201 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-a3185196-5f74-4a9a-9665-a34172bda8ee tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1513 microversion: 2.1 time: 0.154464 Jul 28 17:58:22.318778 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 601/1223] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:58:22 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:58:23.340862 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:23.341537 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:23.347901 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:23.348344 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:23.349123 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:23.349575 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:23.481091 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2277cf311617495cb784285f328451c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed3b5ffc1dd4fb9a814a967d1c9e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:58:23.488640 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-50e5c31f-bd3a-468d-bf7b-702eb18478ca tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 200 len: 1513 microversion: 2.1 time: 0.151783 Jul 28 17:58:23.489225 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 623/1224] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:58:23 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:58:23.640237 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-413671b7-50b0-41aa-ab90-3ae25243f0be req-bd4b5362-7c8a-44ae-a35e-64edcd2c2759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d00f1-3a3a-43fa-b900-c1c9024ff502", "name": "network-vif-deleted", "tag": "2d9c906e-f05b-459d-b9b8-a1edfbf137b9"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:58:23.652437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-413671b7-50b0-41aa-ab90-3ae25243f0be req-bd4b5362-7c8a-44ae-a35e-64edcd2c2759 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:23.652880 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-413671b7-50b0-41aa-ab90-3ae25243f0be req-bd4b5362-7c8a-44ae-a35e-64edcd2c2759 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:23.664701 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-413671b7-50b0-41aa-ab90-3ae25243f0be req-bd4b5362-7c8a-44ae-a35e-64edcd2c2759 service nova] Creating event network-vif-deleted:2d9c906e-f05b-459d-b9b8-a1edfbf137b9 for instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 on hv-cinder-81322 Jul 28 17:58:23.669611 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-413671b7-50b0-41aa-ab90-3ae25243f0be req-bd4b5362-7c8a-44ae-a35e-64edcd2c2759 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Jul 28 17:58:23.670265 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 602/1225] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:58:24.510481 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:58:24.511046 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] [instance: 014d00f1-3a3a-43fa-b900-c1c9024ff502] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:58:24.517540 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:24.517986 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:24.518744 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:58:24.519174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:58:24.533109 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] HTTP exception thrown: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Request method failure captured: Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 HTTP/1.1 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4s3YqKj_-ORTsmlI1aWJ4qf2Kk_-SGMRdKD0t_1lubhM69wEfwsy5K8TQKYJWt3wTLSjWJN_gh7wHsEinHMfv7Q5JcKkW-VhAhVYSbZfNX6BCZO_33UY6Zmd7A7Mqk1g2ES7zz7xLfYs1QL0Z2vU2x1WyuK25E3r0SzUx3yPcl0ZhV0 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 6ed3b5ffc1dd4fb9a814a967d1c9e8dc Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 17:58:24.534749 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/6ed3b5ffc1dd4fb9a814a967d1c9e8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 6ed3b5ffc1dd4fb9a814a967d1c9e8dc Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835545257 Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-VolumesSnapshotTestJSON-835545257-project Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: 2277cf311617495cb784285f328451c5 Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-VolumesSnapshotTestJSON-835545257-project Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. Jul 28 17:58:24.536554 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': '014d00f1-3a3a-43fa-b900-c1c9024ff502'} Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:58:24.537699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. Jul 28 17:58:24.540013 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 17:58:24.541664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] Returning 404 to user: Instance 014d00f1-3a3a-43fa-b900-c1c9024ff502 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:58:24.541664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-fc046720-be88-48d6-a82d-976c151dc979 tempest-VolumesSnapshotTestJSON-835545257 tempest-VolumesSnapshotTestJSON-835545257-project] 10.222.0.89 "GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 28 17:58:24.541664 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 624/1226] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:58:24 2022] GET /compute/v2.1/servers/014d00f1-3a3a-43fa-b900-c1c9024ff502 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 17:59:37.850022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:37.850791 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:37.856540 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-290441680", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858831229", "security_groups": [{"name": "tempest-secgroup-smoke-1200150"}], "block_device_mapping_v2": [{"uuid": "3e0588ca-0319-4c2c-863d-dd91e715e852", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41cb40d0-5f53-4baf-b3ce-649cb31f7aff"}]}} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:59:37.972992 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.network.neutron [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] validate_networks() for [('41cb40d0-5f53-4baf-b3ce-649cb31f7aff', None, None, None, None, None)] {{(pid=124516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 17:59:38.347945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 17:59:38.348370 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image limits 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 17:59:38.348862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Flavor pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 17:59:38.349298 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Image pref 0:0:0 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 17:59:38.349704 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.virt.hardware [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 17:59:38.358916 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:38.359355 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:38.360144 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:38.360573 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:38.377137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 17:59:38.381413 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.quota [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Getting quotas for user c4618ca07ce2408ba90e9eaab0b940c9 and project 1f721aa2c35842beba2060fde666b2a1. Resources: {'ram', 'instances', 'cores'} {{(pid=124516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 17:59:38.440658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Going to run 1 instances... {{(pid=124516) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 17:59:38.442945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e0588ca-0319-4c2c-863d-dd91e715e852',volume_size=None,volume_type=None)] {{(pid=124516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 17:59:38.572401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1cc2e73f-d4ed-4e58-9899-943f3d97e378 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.724536 Jul 28 17:59:38.573064 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 603/1227] 10.222.0.89 () {60 vars in 1147 bytes} [Thu Jul 28 17:59:37 2022] POST /compute/v2.1/servers => generated 403 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 17:59:38.581967 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=8 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:38.582722 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:38.588144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4b8252de-03fc-4af3-8920-56735c48699a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:38.588758 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-4b8252de-03fc-4af3-8920-56735c48699a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:38.643565 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-4b8252de-03fc-4af3-8920-56735c48699a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:38.651832 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4b8252de-03fc-4af3-8920-56735c48699a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1093 microversion: 2.1 time: 0.071720 Jul 28 17:59:38.652398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 625/1228] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:38 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:39.672942 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:39.674124 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:39.681753 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:39.682429 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:39.682985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:39.683425 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:39.765877 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:39.773681 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2332bc5c-dae3-4bd2-87dc-78bfa9881a91 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1209 microversion: 2.1 time: 0.104246 Jul 28 17:59:39.774537 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 604/1229] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:39 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:40.800083 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:40.801574 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:40.809181 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:40.811691 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:40.812757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:40.813458 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:40.966738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:40.974403 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7378bd53-aef5-45ac-b834-4aeb86668c6f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.178271 Jul 28 17:59:40.984053 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 626/1230] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:40 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:41.394707 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-b3546c40-e73d-482d-8a3e-7a85e584c531 req-38ae16ed-0a7b-4e06-9a53-44f03829be55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec71968a-8db8-491f-9f02-cde1ecfc21cc", "tag": "b6bddbab-bd28-4c83-922c-f3f036b1ed41"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:59:41.409336 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-b3546c40-e73d-482d-8a3e-7a85e584c531 req-38ae16ed-0a7b-4e06-9a53-44f03829be55 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:41.410104 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-b3546c40-e73d-482d-8a3e-7a85e584c531 req-38ae16ed-0a7b-4e06-9a53-44f03829be55 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:41.423840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-b3546c40-e73d-482d-8a3e-7a85e584c531 req-38ae16ed-0a7b-4e06-9a53-44f03829be55 service nova] Creating event network-changed:b6bddbab-bd28-4c83-922c-f3f036b1ed41 for instance ec71968a-8db8-491f-9f02-cde1ecfc21cc on hv-cinder-81322 Jul 28 17:59:41.429277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-b3546c40-e73d-482d-8a3e-7a85e584c531 req-38ae16ed-0a7b-4e06-9a53-44f03829be55 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039436 Jul 28 17:59:41.430437 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 605/1231] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:59:42.114946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:42.115559 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:42.122010 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:42.122457 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:42.123213 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:42.123643 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:42.262034 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:42.270378 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d3b89667-e97e-4416-8b85-58edd2d7a63d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.278429 Jul 28 17:59:42.270958 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 627/1232] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:41 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:43.293985 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:43.294623 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:43.300821 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:43.301299 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:43.302075 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:43.302495 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:43.532914 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:43.541563 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-38188deb-3322-4477-ab58-c5947652e745 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.253041 Jul 28 17:59:43.542137 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 606/1233] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:43 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:44.562764 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:44.563375 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:44.569869 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:44.570936 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:44.572051 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:44.572494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:44.706030 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:44.713485 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-53a7286f-f0d8-4e03-bf06-6f7fe2fe3131 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.154619 Jul 28 17:59:44.714052 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 628/1234] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:44 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:45.734638 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:45.735248 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:45.741670 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:45.742581 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:45.743348 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:45.743783 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:45.876149 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:45.884277 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-6d05c910-2def-47e7-9646-ab20bb86bba6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.153529 Jul 28 17:59:45.884853 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 607/1235] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:45 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:46.906140 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:46.906738 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:46.913234 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:46.913687 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:46.914449 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:46.914900 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:47.043426 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:47.050905 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-cbadb15b-77e8-42a5-80c6-926a88205a4f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.148675 Jul 28 17:59:47.051475 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 629/1236] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:46 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:48.072658 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:48.073294 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:48.079808 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:48.080260 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:48.081079 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:48.081487 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:48.228363 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:48.235886 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-09926c17-0a08-451b-87ee-8aec9f4a7399 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.167883 Jul 28 17:59:48.236448 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 608/1237] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:48 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:49.257366 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:49.258186 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:49.260618 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell0:SELECT=2 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:49.265971 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:49.266415 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:49.267174 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:49.267605 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:49.456245 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:49.464645 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-be5030da-79be-471c-9138-378b7c7596aa tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.211233 Jul 28 17:59:49.465235 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 630/1238] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:49 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:50.486253 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:50.486862 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:50.488804 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=2 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:50.489486 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell0:SELECT=6 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:50.497022 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:50.497496 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:50.498264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:50.498693 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:50.628423 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:50.637462 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-eba058a1-b374-46f4-b160-54d248ec2592 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.155281 Jul 28 17:59:50.638038 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 609/1239] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:50 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:51.658753 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:51.659457 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:51.667277 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:51.667727 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:51.668512 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:51.668946 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:51.802147 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:51.811178 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d795135d-c38f-4267-b69f-b4d33f999778 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.156236 Jul 28 17:59:51.811911 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 631/1240] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:51 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:52.832805 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:52.833441 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:52.840203 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:52.840644 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:52.841435 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:52.841927 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:52.979468 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:52.987128 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b2f5e2b4-fe24-4615-bf29-03babbb5482d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.158184 Jul 28 17:59:52.987708 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 610/1241] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:52 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:53.113985 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 17:59:53.114529 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 17:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 17:59:53.876703 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [req-95da4693-32a8-4c1e-99a5-0a4f0b7faaf3 req-527082ec-1d89-464d-92c8-d2f77ff18127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec71968a-8db8-491f-9f02-cde1ecfc21cc", "name": "network-vif-plugged", "status": "completed", "tag": "b6bddbab-bd28-4c83-922c-f3f036b1ed41"}]} {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:59:53.888134 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-95da4693-32a8-4c1e-99a5-0a4f0b7faaf3 req-527082ec-1d89-464d-92c8-d2f77ff18127 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:53.888668 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [req-95da4693-32a8-4c1e-99a5-0a4f0b7faaf3 req-527082ec-1d89-464d-92c8-d2f77ff18127 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:53.900215 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.compute.server_external_events [req-95da4693-32a8-4c1e-99a5-0a4f0b7faaf3 req-527082ec-1d89-464d-92c8-d2f77ff18127 service nova] Creating event network-vif-plugged:b6bddbab-bd28-4c83-922c-f3f036b1ed41 for instance ec71968a-8db8-491f-9f02-cde1ecfc21cc on hv-cinder-81322 Jul 28 17:59:53.905245 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [req-95da4693-32a8-4c1e-99a5-0a4f0b7faaf3 req-527082ec-1d89-464d-92c8-d2f77ff18127 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Jul 28 17:59:53.905833 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 632/1242] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:59:54.007908 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:54.008464 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:54.014974 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:54.015436 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:54.016209 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:54.016648 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:54.163730 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:54.171726 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2abfde0b-c56a-4759-815d-23d8bb9e8a4b tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.167785 Jul 28 17:59:54.172289 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 611/1243] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:54 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:55.194047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:55.194741 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:55.201316 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:55.201757 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:55.202509 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:55.202937 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:55.341093 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:55.348582 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-83672d86-0d5d-45d2-baf1-df055a05dbb6 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1262 microversion: 2.1 time: 0.159240 Jul 28 17:59:55.349144 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 633/1244] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:55 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:56.371096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:56.371702 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:56.378193 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:56.378843 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:56.379613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:56.380042 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:56.510590 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:56.517989 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-42486076-58a0-48a2-aa58-05e0cd988aa0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1449 microversion: 2.1 time: 0.151882 Jul 28 17:59:56.518552 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 612/1245] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:56 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:56.539328 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:56.539942 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 17:59:56.546483 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:56.546933 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:56.547699 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:56.548132 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:56.678285 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 17:59:56.686788 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-8b729183-3b14-4c8d-bf9a-4f595d7b784e tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1449 microversion: 2.1 time: 0.151933 Jul 28 17:59:56.687355 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 634/1246] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 17:59:56 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:58.271252 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-f531b9fe-b4f1-4491-a4f5-0f46c4a7b705 req-a39e7c56-e9b6-4a0f-8373-5dc60153f078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec71968a-8db8-491f-9f02-cde1ecfc21cc", "tag": "b6bddbab-bd28-4c83-922c-f3f036b1ed41"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:59:58.283093 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-f531b9fe-b4f1-4491-a4f5-0f46c4a7b705 req-a39e7c56-e9b6-4a0f-8373-5dc60153f078 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:58.283522 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-f531b9fe-b4f1-4491-a4f5-0f46c4a7b705 req-a39e7c56-e9b6-4a0f-8373-5dc60153f078 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:58.295688 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-f531b9fe-b4f1-4491-a4f5-0f46c4a7b705 req-a39e7c56-e9b6-4a0f-8373-5dc60153f078 service nova] Creating event network-changed:b6bddbab-bd28-4c83-922c-f3f036b1ed41 for instance ec71968a-8db8-491f-9f02-cde1ecfc21cc on hv-cinder-81322 Jul 28 17:59:58.300757 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-f531b9fe-b4f1-4491-a4f5-0f46c4a7b705 req-a39e7c56-e9b6-4a0f-8373-5dc60153f078 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034338 Jul 28 17:59:58.301402 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 613/1247] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:00:04.656140 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:00:04.656777 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Thu Jul 28 18:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:01:23.723463 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:01:23.724107 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 18:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:01:28.684388 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:28.685401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG dbcounter [-] [124516] Writing DB stats nova_cell1:SELECT=54 {{(pid=124516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:28.685601 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:28.686766 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:28.689076 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_api:SELECT=22 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:28.689928 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG dbcounter [-] [124515] Writing DB stats nova_cell1:SELECT=50 {{(pid=124515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:28.703371 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:28.704507 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:28.705345 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:28.705788 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:28.735519 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:01:28.764539 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-c6782e3e-14b3-498c-a7ba-f9a628940fe4 req-724ad9f5-316d-4f72-809e-6c9e86c8b8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec71968a-8db8-491f-9f02-cde1ecfc21cc", "tag": "b6bddbab-bd28-4c83-922c-f3f036b1ed41"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:28.775244 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c6782e3e-14b3-498c-a7ba-f9a628940fe4 req-724ad9f5-316d-4f72-809e-6c9e86c8b8a1 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:28.775686 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-c6782e3e-14b3-498c-a7ba-f9a628940fe4 req-724ad9f5-316d-4f72-809e-6c9e86c8b8a1 service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:28.787465 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-c6782e3e-14b3-498c-a7ba-f9a628940fe4 req-724ad9f5-316d-4f72-809e-6c9e86c8b8a1 service nova] Creating event network-changed:b6bddbab-bd28-4c83-922c-f3f036b1ed41 for instance ec71968a-8db8-491f-9f02-cde1ecfc21cc on hv-cinder-81322 Jul 28 18:01:28.792838 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-c6782e3e-14b3-498c-a7ba-f9a628940fe4 req-724ad9f5-316d-4f72-809e-6c9e86c8b8a1 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110240 Jul 28 18:01:28.796401 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 614/1248] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 18:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:28.826048 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-7cae33c0-bcbb-4895-89e4-acfa83d462b7 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "DELETE /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 204 len: 0 microversion: 2.1 time: 0.145803 Jul 28 18:01:28.826957 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 635/1249] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 18:01:28 2022] DELETE /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:01:28.841141 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:28.842280 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:28.855535 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:28.856133 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:28.856933 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:28.857402 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:29.001050 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:29.009096 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1e5dafea-63f1-4ab8-8167-075b622ffb4d tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1574 microversion: 2.1 time: 0.175883 Jul 28 18:01:29.009691 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 615/1250] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:28 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:30.035082 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:30.035682 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:30.045065 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:30.045827 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:30.047326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:30.047761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:30.189313 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:30.197322 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-de49e141-f658-4ade-859a-52a545ba9e35 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1574 microversion: 2.1 time: 0.169829 Jul 28 18:01:30.197895 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 636/1251] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:30 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:31.092835 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-05f75508-5d54-4d20-8acd-a16342fed453 req-cee86bd8-4851-4e87-8ffa-9a449a090dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec71968a-8db8-491f-9f02-cde1ecfc21cc", "name": "network-vif-deleted", "tag": "b6bddbab-bd28-4c83-922c-f3f036b1ed41"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:31.103602 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-05f75508-5d54-4d20-8acd-a16342fed453 req-cee86bd8-4851-4e87-8ffa-9a449a090dcd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:31.103990 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-05f75508-5d54-4d20-8acd-a16342fed453 req-cee86bd8-4851-4e87-8ffa-9a449a090dcd service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:31.116863 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-05f75508-5d54-4d20-8acd-a16342fed453 req-cee86bd8-4851-4e87-8ffa-9a449a090dcd service nova] Creating event network-vif-deleted:b6bddbab-bd28-4c83-922c-f3f036b1ed41 for instance ec71968a-8db8-491f-9f02-cde1ecfc21cc on hv-cinder-81322 Jul 28 18:01:31.122403 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-05f75508-5d54-4d20-8acd-a16342fed453 req-cee86bd8-4851-4e87-8ffa-9a449a090dcd service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033273 Jul 28 18:01:31.122920 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 616/1252] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:31.218981 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:31.219600 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:31.226879 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:31.227327 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:31.228095 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:31.228530 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:31.290353 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:31.298078 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-dfec58a3-0405-4947-8825-26ac7fb4d9d0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 200 len: 1224 microversion: 2.1 time: 0.082951 Jul 28 18:01:31.298728 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 637/1253] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:31 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:32.320945 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:32.321756 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: ec71968a-8db8-491f-9f02-cde1ecfc21cc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:32.327918 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:32.328361 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:32.329109 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:32.329613 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:32.343288 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] HTTP exception thrown: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Request method failure captured: Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc HTTP/1.1 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4s1b7D0TqThtayJ9ARWtYHOlqi_Ap0lckG2bNEF-cgOwcKGEiNwFoVacLPoXIUbylIJFOpKS7qVstjeX1QPZ0JSdr6tvwpAVqiTLMMuHHR3sBdCfE2FWGq1-SxAFifE6GsynVFvCmyGfpyZtH8nvmATFpVZ6dbJa7u6jFg-y3SYMTmQ Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 18:01:32.344905 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: c4618ca07ce2408ba90e9eaab0b940c9 Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. Jul 28 18:01:32.346831 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'ec71968a-8db8-491f-9f02-cde1ecfc21cc'} Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:01:32.347988 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. Jul 28 18:01:32.350854 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:32.352536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Returning 404 to user: Instance ec71968a-8db8-491f-9f02-cde1ecfc21cc could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:01:32.352536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-b6a01881-b7eb-4072-b049-06851a7893dd tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc" status: 404 len: 111 microversion: 2.1 time: 0.030461 Jul 28 18:01:32.352536 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 617/1254] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:32 2022] GET /compute/v2.1/servers/ec71968a-8db8-491f-9f02-cde1ecfc21cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:35.425016 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:35.425760 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:35.428470 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-3c314086-4268-449b-89d4-99fda1b2c3d8 req-898b0127-970a-4394-9a90-c8357a71bf6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc646c95-2b66-46b9-94d8-df973d9160fc", "tag": "3bf83eb7-bb7a-49cc-836d-ab20bf06936c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:35.432253 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:35.432702 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:35.433489 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:35.433917 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:35.439600 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-3c314086-4268-449b-89d4-99fda1b2c3d8 req-898b0127-970a-4394-9a90-c8357a71bf6a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:35.440134 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-3c314086-4268-449b-89d4-99fda1b2c3d8 req-898b0127-970a-4394-9a90-c8357a71bf6a service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:35.452082 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-3c314086-4268-449b-89d4-99fda1b2c3d8 req-898b0127-970a-4394-9a90-c8357a71bf6a service nova] Creating event network-changed:3bf83eb7-bb7a-49cc-836d-ab20bf06936c for instance cc646c95-2b66-46b9-94d8-df973d9160fc on hv-cinder-81322 Jul 28 18:01:35.457537 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-3c314086-4268-449b-89d4-99fda1b2c3d8 req-898b0127-970a-4394-9a90-c8357a71bf6a service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033919 Jul 28 18:01:35.458925 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 618/1255] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:35.461494 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Going to try to terminate instance {{(pid=124515) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:01:35.561228 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-c51174ad-75e6-405f-b1c3-627331f8eac0 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "DELETE /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 204 len: 0 microversion: 2.1 time: 0.140230 Jul 28 18:01:35.562406 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 638/1256] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 18:01:35 2022] DELETE /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:01:35.571131 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:35.571840 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:35.580676 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:35.581482 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:35.582505 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:35.583172 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:35.742997 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.policy [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124516) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:35.750622 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-2af22bb4-16c0-46a1-927c-b0193cd21815 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1574 microversion: 2.1 time: 0.183992 Jul 28 18:01:35.751206 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 619/1257] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:35 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:36.773632 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:36.774763 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:36.781552 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:36.781994 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:36.782761 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:36.783188 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:36.919590 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:36.927326 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-008e1328-75c1-477c-a470-6265f2c2e73a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1574 microversion: 2.1 time: 0.158697 Jul 28 18:01:36.928255 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 639/1258] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:36 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:37.726369 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [req-1051b1a1-9e9a-4a50-96f1-33ee02fed289 req-3205efb6-e92c-48dc-a0ab-9dc87063447d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc646c95-2b66-46b9-94d8-df973d9160fc", "name": "network-vif-deleted", "tag": "3bf83eb7-bb7a-49cc-836d-ab20bf06936c"}]} {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:37.736192 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-1051b1a1-9e9a-4a50-96f1-33ee02fed289 req-3205efb6-e92c-48dc-a0ab-9dc87063447d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:37.736642 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [req-1051b1a1-9e9a-4a50-96f1-33ee02fed289 req-3205efb6-e92c-48dc-a0ab-9dc87063447d service nova] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:37.748560 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.compute.server_external_events [req-1051b1a1-9e9a-4a50-96f1-33ee02fed289 req-3205efb6-e92c-48dc-a0ab-9dc87063447d service nova] Creating event network-vif-deleted:3bf83eb7-bb7a-49cc-836d-ab20bf06936c for instance cc646c95-2b66-46b9-94d8-df973d9160fc on hv-cinder-81322 Jul 28 18:01:37.753773 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [req-1051b1a1-9e9a-4a50-96f1-33ee02fed289 req-3205efb6-e92c-48dc-a0ab-9dc87063447d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031076 Jul 28 18:01:37.754345 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 620/1259] 10.222.0.89 () {64 vars in 1317 bytes} [Thu Jul 28 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:37.949246 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:37.949913 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:37.956517 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:37.956962 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:37.957755 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:37.958190 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:38.030477 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.policy [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4618ca07ce2408ba90e9eaab0b940c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f721aa2c35842beba2060fde666b2a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124515) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:01:38.039710 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-d90f4e1f-7d0d-4859-9015-e4f36e667985 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 200 len: 1225 microversion: 2.1 time: 0.094483 Jul 28 18:01:38.040310 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 640/1260] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:37 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:01:39.064376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:39.064990 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: cc646c95-2b66-46b9-94d8-df973d9160fc] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:39.071420 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.071875 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.072651 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.073089 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.087177 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] HTTP exception thrown: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Request method failure captured: Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc HTTP/1.1 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4s1b7D0TqThtayJ9ARWtYHOlqi_Ap0lckG2bNEF-cgOwcKGEiNwFoVacLPoXIUbylIJFOpKS7qVstjeX1QPZ0JSdr6tvwpAVqiTLMMuHHR3sBdCfE2FWGq1-SxAFifE6GsynVFvCmyGfpyZtH8nvmATFpVZ6dbJa7u6jFg-y3SYMTmQ Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 18:01:39.088787 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: c4618ca07ce2408ba90e9eaab0b940c9 Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. Jul 28 18:01:39.090515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'cc646c95-2b66-46b9-94d8-df973d9160fc'} Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:01:39.091463 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. Jul 28 18:01:39.093231 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.094958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Returning 404 to user: Instance cc646c95-2b66-46b9-94d8-df973d9160fc could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:01:39.094958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-1d615dee-f134-49c1-b5b2-cc5a3b6dbf27 tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc" status: 404 len: 111 microversion: 2.1 time: 0.030957 Jul 28 18:01:39.094958 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 621/1261] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:39 2022] GET /compute/v2.1/servers/cc646c95-2b66-46b9-94d8-df973d9160fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:39.539192 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:39.539718 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.compute.api [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124515) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:39.545907 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.546347 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.547098 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.547523 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG oslo_concurrency.lockutils [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.561956 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.wsgi [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] HTTP exception thrown: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Request method failure captured: Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: request: DELETE /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 HTTP/1.1 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept: application/json Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Accept-Encoding: identity Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Connection: close Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Length: 0 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Content-Type: application/json Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Host: 10.222.0.89 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Openstack-System-Scope: None Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: User-Agent: python-urllib3/1.26.10 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Auth-Token: gAAAAABi4s1b7D0TqThtayJ9ARWtYHOlqi_Ap0lckG2bNEF-cgOwcKGEiNwFoVacLPoXIUbylIJFOpKS7qVstjeX1QPZ0JSdr6tvwpAVqiTLMMuHHR3sBdCfE2FWGq1-SxAFifE6GsynVFvCmyGfpyZtH8nvmATFpVZ6dbJa7u6jFg-y3SYMTmQ Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Id: None Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Domain-Name: None Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Identity-Status: Confirmed Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Is-Admin-Project: True Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Id: default Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Domain-Name: Default Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Project-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Role: reader,member Jul 28 18:01:39.563617 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Roles: reader,member Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-Tenant-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Id: default Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Domain-Name: Default Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Id: c4618ca07ce2408ba90e9eaab0b940c9 Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: X-User-Name: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: method: > Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: exception: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.565391 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: action_args: {'id': 'e7a3017f-73cc-4824-a620-0bc87d8181a5'} Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:01:39.566238 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.568015 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.569578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Returning 404 to user: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. {{(pid=124515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:01:39.569578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-bc0a09f4-4870-4dfc-8b54-dff5ffb9ad5c tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "DELETE /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jul 28 18:01:39.569578 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 641/1262] 10.222.0.89 () {58 vars in 1239 bytes} [Thu Jul 28 18:01:39 2022] DELETE /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:39.574074 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '>' {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:39.574720 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.compute.api [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] [instance: e7a3017f-73cc-4824-a620-0bc87d8181a5] Fetching instance by UUID {{(pid=124516) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:01:39.580830 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.581312 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.582084 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:39.582515 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG oslo_concurrency.lockutils [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Lock "5c442d92-b981-4069-943a-49d075b5aed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:39.596264 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.wsgi [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] HTTP exception thrown: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Request method failure captured: Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: request: GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 HTTP/1.1 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept: application/json Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Accept-Encoding: identity Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Connection: close Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Length: 0 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Content-Type: application/json Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Host: 10.222.0.89 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Openstack-System-Scope: None Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: User-Agent: python-urllib3/1.26.10 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Auth-Token: gAAAAABi4s1b7D0TqThtayJ9ARWtYHOlqi_Ap0lckG2bNEF-cgOwcKGEiNwFoVacLPoXIUbylIJFOpKS7qVstjeX1QPZ0JSdr6tvwpAVqiTLMMuHHR3sBdCfE2FWGq1-SxAFifE6GsynVFvCmyGfpyZtH8nvmATFpVZ6dbJa7u6jFg-y3SYMTmQ Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Id: None Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Domain-Name: None Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Identity-Status: Confirmed Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Is-Admin-Project: True Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Id: default Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Domain-Name: Default Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Project-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Role: reader,member Jul 28 18:01:39.597807 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Roles: reader,member Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.89:8080", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1f721aa2c35842beba2060fde666b2a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}] Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Id: 1f721aa2c35842beba2060fde666b2a1 Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-Tenant-Name: tempest-TestVolumeBootPattern-1149748701 Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Id: default Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Domain-Name: Default Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Id: c4618ca07ce2408ba90e9eaab0b940c9 Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: X-User-Name: tempest-TestVolumeBootPattern-1149748701-project Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: method: > Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: exception: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.600159 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: action_args: {'id': 'e7a3017f-73cc-4824-a620-0bc87d8181a5'} Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: {{(pid=124516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:01:39.601184 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. Jul 28 18:01:39.602874 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: ERROR nova.api.openstack.wsgi Jul 28 18:01:39.604376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: DEBUG nova.api.openstack.wsgi [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Returning 404 to user: Instance e7a3017f-73cc-4824-a620-0bc87d8181a5 could not be found. {{(pid=124516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:01:39.604376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO nova.api.openstack.requestlog [None req-e6e5666d-1782-4319-a7d6-0e356fb6525a tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5" status: 404 len: 111 microversion: 2.1 time: 0.029020 Jul 28 18:01:39.604376 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: [pid: 124516|app: 0|req: 622/1263] 10.222.0.89 () {58 vars in 1236 bytes} [Thu Jul 28 18:01:39 2022] GET /compute/v2.1/servers/e7a3017f-73cc-4824-a620-0bc87d8181a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:40.902919 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: DEBUG nova.api.openstack.wsgi [None req-4c695bd6-d0ba-4c62-8d80-ebad458d440f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] Calling method '.version_select at 0x7fce3a117940>' {{(pid=124515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:40.928533 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO nova.api.openstack.requestlog [None req-4c695bd6-d0ba-4c62-8d80-ebad458d440f tempest-TestVolumeBootPattern-1149748701 tempest-TestVolumeBootPattern-1149748701-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-858831229" status: 202 len: 0 microversion: 2.1 time: 0.029595 Jul 28 18:01:40.929782 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: [pid: 124515|app: 0|req: 642/1264] 10.222.0.89 () {58 vars in 1260 bytes} [Thu Jul 28 18:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-858831229 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:03:13.122701 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:03:13.123398 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 18:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:03:24.665080 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:03:24.665718 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Thu Jul 28 18:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:04:40.777820 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:04:40.778533 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Thu Jul 28 18:04:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:04:43.732662 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:04:43.733314 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 18:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:06:33.135479 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:06:33.136269 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 18:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:06:38.554452 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:06:38.555047 dv-cinder-813229-13-iscsi devstack@n-api.service[124515]: Thu Jul 28 18:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:06:44.673451 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:06:44.674033 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Thu Jul 28 18:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:06:45.152973 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:06:45.153491 dv-cinder-813229-13-iscsi devstack@n-api.service[124516]: Thu Jul 28 18:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!